2026-02-13T01:13:35.017 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T01:13:35.037 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:13:35.121 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421 branch: wip-pdonnell-testing-20260210.171210 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47421' kernel: client: branch: testing sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true fuse default permissions: false fuse set user groups: true global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.2 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 781/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIYf65Zrm5RYN4VbQ9vESJ7hImtrbfyNNaGioyEJI92sNE0LGqJfNp7uUaYRWhdWu8AAg3un+071RsfqN8vMyMc= trial055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPv8WiWS+glpsVzeI3ll7h3Fav+XXv5Zxj+EsuFYbNLin0txGi5JeJpvsyYmx/GAmKgbbwFEndMzFWNGxI2B/z0= trial118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5l5VIR/6cbnqeCzfc+mGAxR+GZW3c1EITskCP2WKzy7uGqGQozY8PtN8rq5YvQfMpsngGp+TpBUyBgF7EiP6Y= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.20 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((800-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-3 teuthology_sha1: a2c505dae37458c5537fa44f1320bd04eef25bb1 timestamp: 2026-02-13_01:09:17 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T01:13:35.121 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-13T01:13:35.122 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-13T01:13:35.122 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T01:13:35.123 INFO:teuthology.task.internal:Checking packages... 2026-02-13T01:13:35.123 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-13T01:13:35.123 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T01:13:35.123 INFO:teuthology.packaging:ref: None 2026-02-13T01:13:35.123 INFO:teuthology.packaging:tag: None 2026-02-13T01:13:35.123 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-13T01:13:35.123 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:13:35.124 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-13T01:13:35.241 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-13T01:13:35.242 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T01:13:35.260 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T01:13:35.260 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T01:13:35.275 INFO:teuthology.task.internal:Saving configuration 2026-02-13T01:13:35.297 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T01:13:35.310 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T01:13:35.385 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial040.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 01:10:12.895509', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIYf65Zrm5RYN4VbQ9vESJ7hImtrbfyNNaGioyEJI92sNE0LGqJfNp7uUaYRWhdWu8AAg3un+071RsfqN8vMyMc='} 2026-02-13T01:13:35.443 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial055.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 01:10:12.894474', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPv8WiWS+glpsVzeI3ll7h3Fav+XXv5Zxj+EsuFYbNLin0txGi5JeJpvsyYmx/GAmKgbbwFEndMzFWNGxI2B/z0='} 2026-02-13T01:13:35.507 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial118.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 01:10:12.895046', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5l5VIR/6cbnqeCzfc+mGAxR+GZW3c1EITskCP2WKzy7uGqGQozY8PtN8rq5YvQfMpsngGp+TpBUyBgF7EiP6Y='} 2026-02-13T01:13:35.507 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T01:13:35.519 INFO:teuthology.task.internal:roles: ubuntu@trial040.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-13T01:13:35.519 INFO:teuthology.task.internal:roles: ubuntu@trial055.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-13T01:13:35.519 INFO:teuthology.task.internal:roles: ubuntu@trial118.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-13T01:13:35.519 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T01:13:35.726 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72043af08720>, signals=[15]) 2026-02-13T01:13:35.727 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T01:13:35.738 INFO:teuthology.task.internal:Opening connections... 2026-02-13T01:13:35.738 DEBUG:teuthology.task.internal:connecting to ubuntu@trial040.front.sepia.ceph.com 2026-02-13T01:13:35.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:35.801 DEBUG:teuthology.task.internal:connecting to ubuntu@trial055.front.sepia.ceph.com 2026-02-13T01:13:35.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:35.861 DEBUG:teuthology.task.internal:connecting to ubuntu@trial118.front.sepia.ceph.com 2026-02-13T01:13:35.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:35.924 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T01:13:35.938 DEBUG:teuthology.orchestra.run.trial040:> uname -m 2026-02-13T01:13:35.953 INFO:teuthology.orchestra.run.trial040.stdout:x86_64 2026-02-13T01:13:35.953 DEBUG:teuthology.orchestra.run.trial040:> cat /etc/os-release 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:NAME="CentOS Stream" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:VERSION="9" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:ID="centos" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:ID_LIKE="rhel fedora" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_ID="9" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:PLATFORM_ID="platform:el9" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:ANSI_COLOR="0;31" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:HOME_URL="https://centos.org/" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T01:13:36.009 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T01:13:36.010 INFO:teuthology.lock.ops:Updating trial040.front.sepia.ceph.com on lock server 2026-02-13T01:13:36.097 DEBUG:teuthology.orchestra.run.trial055:> uname -m 2026-02-13T01:13:36.112 INFO:teuthology.orchestra.run.trial055.stdout:x86_64 2026-02-13T01:13:36.112 DEBUG:teuthology.orchestra.run.trial055:> cat /etc/os-release 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:NAME="CentOS Stream" 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:VERSION="9" 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:ID="centos" 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:ID_LIKE="rhel fedora" 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:VERSION_ID="9" 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:PLATFORM_ID="platform:el9" 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:ANSI_COLOR="0;31" 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:13:36.167 INFO:teuthology.orchestra.run.trial055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T01:13:36.168 INFO:teuthology.orchestra.run.trial055.stdout:HOME_URL="https://centos.org/" 2026-02-13T01:13:36.168 INFO:teuthology.orchestra.run.trial055.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T01:13:36.168 INFO:teuthology.orchestra.run.trial055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T01:13:36.168 INFO:teuthology.orchestra.run.trial055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T01:13:36.168 INFO:teuthology.lock.ops:Updating trial055.front.sepia.ceph.com on lock server 2026-02-13T01:13:36.247 DEBUG:teuthology.orchestra.run.trial118:> uname -m 2026-02-13T01:13:36.263 INFO:teuthology.orchestra.run.trial118.stdout:x86_64 2026-02-13T01:13:36.263 DEBUG:teuthology.orchestra.run.trial118:> cat /etc/os-release 2026-02-13T01:13:36.318 INFO:teuthology.orchestra.run.trial118.stdout:NAME="CentOS Stream" 2026-02-13T01:13:36.318 INFO:teuthology.orchestra.run.trial118.stdout:VERSION="9" 2026-02-13T01:13:36.318 INFO:teuthology.orchestra.run.trial118.stdout:ID="centos" 2026-02-13T01:13:36.318 INFO:teuthology.orchestra.run.trial118.stdout:ID_LIKE="rhel fedora" 2026-02-13T01:13:36.318 INFO:teuthology.orchestra.run.trial118.stdout:VERSION_ID="9" 2026-02-13T01:13:36.318 INFO:teuthology.orchestra.run.trial118.stdout:PLATFORM_ID="platform:el9" 2026-02-13T01:13:36.319 INFO:teuthology.orchestra.run.trial118.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T01:13:36.319 INFO:teuthology.orchestra.run.trial118.stdout:ANSI_COLOR="0;31" 2026-02-13T01:13:36.319 INFO:teuthology.orchestra.run.trial118.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:13:36.319 INFO:teuthology.orchestra.run.trial118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T01:13:36.319 INFO:teuthology.orchestra.run.trial118.stdout:HOME_URL="https://centos.org/" 2026-02-13T01:13:36.319 INFO:teuthology.orchestra.run.trial118.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T01:13:36.319 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T01:13:36.319 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T01:13:36.319 INFO:teuthology.lock.ops:Updating trial118.front.sepia.ceph.com on lock server 2026-02-13T01:13:36.382 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T01:13:36.395 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T01:13:36.406 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T01:13:36.406 DEBUG:teuthology.orchestra.run.trial040:> test '!' -e /home/ubuntu/cephtest 2026-02-13T01:13:36.408 DEBUG:teuthology.orchestra.run.trial055:> test '!' -e /home/ubuntu/cephtest 2026-02-13T01:13:36.409 DEBUG:teuthology.orchestra.run.trial118:> test '!' -e /home/ubuntu/cephtest 2026-02-13T01:13:36.424 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T01:13:36.435 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T01:13:36.435 DEBUG:teuthology.orchestra.run.trial040:> test -z $(ls -A /var/lib/ceph) 2026-02-13T01:13:36.463 DEBUG:teuthology.orchestra.run.trial055:> test -z $(ls -A /var/lib/ceph) 2026-02-13T01:13:36.465 DEBUG:teuthology.orchestra.run.trial118:> test -z $(ls -A /var/lib/ceph) 2026-02-13T01:13:36.483 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T01:13:36.701 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T01:13:36.721 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'sha1': 'distro'} 2026-02-13T01:13:36.721 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2026-02-13T01:13:36.721 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2026-02-13T01:13:36.721 DEBUG:teuthology.orchestra.run.trial040:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T01:13:36.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:13:36.736 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2026-02-13T01:13:36.876 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T01:13:36.876 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-13T01:13:36.876 DEBUG:teuthology.orchestra.run.trial040:> uname -r 2026-02-13T01:13:36.892 INFO:teuthology.orchestra.run.trial040.stdout:5.14.0-645.el9.x86_64 2026-02-13T01:13:36.892 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T01:13:36.893 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-13T01:13:36.893 DEBUG:teuthology.orchestra.run.trial040:> sudo yum upgrade -y linux-firmware 2026-02-13T01:13:37.801 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.9 MB 00:00 2026-02-13T01:13:40.878 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T01:13:44.186 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 7.8 MB 00:00 2026-02-13T01:13:45.926 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-13T01:13:47.007 INFO:teuthology.orchestra.run.trial040.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:01 2026-02-13T01:13:50.217 INFO:teuthology.orchestra.run.trial040.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-13T01:13:51.305 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-13T01:13:51.305 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-13T01:13:51.305 INFO:teuthology.orchestra.run.trial040.stdout: Package Architecture Version Repository Size 2026-02-13T01:13:51.305 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-13T01:13:51.305 INFO:teuthology.orchestra.run.trial040.stdout:Upgrading: 2026-02-13T01:13:51.305 INFO:teuthology.orchestra.run.trial040.stdout: linux-firmware noarch 20260130-160.el9 baseos 610 M 2026-02-13T01:13:51.305 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:13:51.305 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-13T01:13:51.306 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-13T01:13:51.306 INFO:teuthology.orchestra.run.trial040.stdout:Upgrade 1 Package 2026-02-13T01:13:51.306 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:13:51.306 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 610 M 2026-02-13T01:13:51.306 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-13T01:14:05.851 INFO:teuthology.orchestra.run.trial040.stdout:linux-firmware-20260130-160.el9.noarch.rpm 42 MB/s | 610 MB 00:14 2026-02-13T01:14:05.851 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:14:05.851 INFO:teuthology.orchestra.run.trial040.stdout:Total 42 MB/s | 610 MB 00:14 2026-02-13T01:14:06.910 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-13T01:14:06.928 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-13T01:14:06.929 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-13T01:14:08.780 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-13T01:14:08.781 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-13T01:14:10.594 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: linux-firmware-20260130-160.el9.noarch 1/1 2026-02-13T01:14:12.570 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-13T01:14:12.596 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : linux-firmware-20260130-160.el9.noarch 1/2 2026-02-13T01:14:12.619 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T01:14:12.878 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T01:14:12.878 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : linux-firmware-20260130-160.el9.noarch 1/2 2026-02-13T01:14:12.928 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T01:14:12.928 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:14:12.928 INFO:teuthology.orchestra.run.trial040.stdout:Upgraded: 2026-02-13T01:14:12.929 INFO:teuthology.orchestra.run.trial040.stdout: linux-firmware-20260130-160.el9.noarch 2026-02-13T01:14:12.929 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:14:12.929 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-13T01:14:13.022 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-13T01:14:13.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T01:14:13.197 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-13T01:14:13.197 DEBUG:teuthology.orchestra.run.trial040:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-13T01:14:13.199 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial040.front.sepia.ceph.com to complete... 2026-02-13T01:14:19.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13 01:14:19 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-13T01:14:19.789 INFO:teuthology.orchestra.run.trial040.stderr:FINISHED --2026-02-13 01:14:19-- 2026-02-13T01:14:19.789 INFO:teuthology.orchestra.run.trial040.stderr:Total wall clock time: 6.6s 2026-02-13T01:14:19.789 INFO:teuthology.orchestra.run.trial040.stderr:Downloaded: 1 files, 370M in 6.5s (57.3 MB/s) 2026-02-13T01:14:19.794 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-13T01:14:19.794 DEBUG:teuthology.orchestra.run.trial040:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-13T01:14:20.921 INFO:teuthology.orchestra.run.trial040.stdout:Verifying... ######################################## 2026-02-13T01:14:20.948 INFO:teuthology.orchestra.run.trial040.stdout:Preparing... ######################################## 2026-02-13T01:14:20.961 INFO:teuthology.orchestra.run.trial040.stdout:Updating / installing... 2026-02-13T01:14:24.125 INFO:teuthology.orchestra.run.trial040.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-13T01:14:39.595 INFO:teuthology.orchestra.run.trial040.stderr:sed: can't read /lib/modules/6.19.0-g8dec4b357aab/.vmlinuz.hmac: No such file or directory 2026-02-13T01:14:39.595 INFO:teuthology.orchestra.run.trial040.stderr:Can't create '/boot/.vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566.hmac' from '/lib/modules/6.19.0-g8dec4b357aab/.vmlinuz.hmac'! 2026-02-13T01:15:30.911 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial040.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-13T01:15:30.911 DEBUG:teuthology.orchestra.run.trial040:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-13T01:15:30.964 INFO:teuthology.orchestra.run.trial040.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-13T01:15:30.964 INFO:teuthology.orchestra.run.trial040.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-13T01:15:30.964 INFO:teuthology.orchestra.run.trial040.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-13T01:15:30.964 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-13T01:15:30.965 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-13T01:15:30.966 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-13T01:15:30.967 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-13T01:15:30.968 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-13T01:15:30.969 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-13T01:15:30.970 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-13T01:15:30.971 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-13T01:15:30.972 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-13T01:15:30.973 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-13T01:15:30.974 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-13T01:15:30.975 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-13T01:15:30.976 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-13T01:15:30.977 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-13T01:15:30.978 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-13T01:15:30.979 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-13T01:15:30.980 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-13T01:15:30.981 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-13T01:15:30.982 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-13T01:15:30.983 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-13T01:15:30.984 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-13T01:15:30.985 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-13T01:15:30.986 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-13T01:15:30.987 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-13T01:15:30.988 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-13T01:15:30.989 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-13T01:15:30.990 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-13T01:15:30.991 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-13T01:15:30.992 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-13T01:15:30.993 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-13T01:15:30.994 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-13T01:15:30.995 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-13T01:15:30.996 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-13T01:15:30.997 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-13T01:15:30.998 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-13T01:15:30.999 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-13T01:15:31.000 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-13T01:15:31.001 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-13T01:15:31.002 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-13T01:15:31.003 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-13T01:15:31.004 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-13T01:15:31.005 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-13T01:15:31.006 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-13T01:15:31.007 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-13T01:15:31.008 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-13T01:15:31.009 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-13T01:15:31.010 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-13T01:15:31.011 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-13T01:15:31.012 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-13T01:15:31.013 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-13T01:15:31.014 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-13T01:15:31.015 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-13T01:15:31.016 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-13T01:15:31.017 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-13T01:15:31.018 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-13T01:15:31.019 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-13T01:15:31.020 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-13T01:15:31.021 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-13T01:15:31.022 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-13T01:15:31.023 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-13T01:15:31.024 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-13T01:15:31.025 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-13T01:15:31.026 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-13T01:15:31.027 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-13T01:15:31.028 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-13T01:15:31.029 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-13T01:15:31.030 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-13T01:15:31.031 INFO:teuthology.orchestra.run.trial040.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-13T01:15:31.033 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-13T01:15:31.033 DEBUG:teuthology.orchestra.run.trial040:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:postinstall scriptlet (using /bin/sh): 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:fi 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:for file in vmlinuz System.map config; do 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout: fi 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:done 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:fi 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:fi 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-13T01:15:31.053 INFO:teuthology.orchestra.run.trial040.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-13T01:15:31.054 INFO:teuthology.orchestra.run.trial040.stdout:fi 2026-02-13T01:15:31.054 DEBUG:teuthology.orchestra.run.trial040:> sudo rpm -qi grub2-tools 2026-02-13T01:15:31.121 INFO:teuthology.orchestra.run.trial040.stdout:Name : grub2-tools 2026-02-13T01:15:31.121 INFO:teuthology.orchestra.run.trial040.stdout:Epoch : 1 2026-02-13T01:15:31.121 INFO:teuthology.orchestra.run.trial040.stdout:Version : 2.06 2026-02-13T01:15:31.121 INFO:teuthology.orchestra.run.trial040.stdout:Release : 118.el9 2026-02-13T01:15:31.121 INFO:teuthology.orchestra.run.trial040.stdout:Architecture: x86_64 2026-02-13T01:15:31.121 INFO:teuthology.orchestra.run.trial040.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T01:15:31.121 INFO:teuthology.orchestra.run.trial040.stdout:Group : Unspecified 2026-02-13T01:15:31.121 INFO:teuthology.orchestra.run.trial040.stdout:Size : 8393909 2026-02-13T01:15:31.121 INFO:teuthology.orchestra.run.trial040.stdout:License : GPLv3+ 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:Packager : builder@centos.org 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:Vendor : CentOS 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:Summary : Support tools for GRUB. 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:Description : 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:hardware devices. 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:15:31.122 INFO:teuthology.orchestra.run.trial040.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T01:15:31.123 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T01:15:31.123 INFO:teuthology.task.kernel:Updating grub on trial040 to boot 6.19.0-g8dec4b357aab 2026-02-13T01:15:31.123 DEBUG:teuthology.orchestra.run.trial040:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T01:15:31.186 INFO:teuthology.orchestra.run.trial040.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T01:15:31.187 DEBUG:teuthology.orchestra.run.trial040:> sudo command -v grubby && echo yes || echo no 2026-02-13T01:15:31.249 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/grubby 2026-02-13T01:15:31.251 INFO:teuthology.orchestra.run.trial040.stdout:yes 2026-02-13T01:15:31.251 DEBUG:teuthology.orchestra.run.trial040:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-13T01:15:31.315 INFO:teuthology.orchestra.run.trial040.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-13T01:15:31.316 DEBUG:teuthology.orchestra.run.trial040:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-13T01:15:31.391 DEBUG:teuthology.orchestra.run.trial040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T01:15:31.605 INFO:teuthology.orchestra.run.trial040.stderr:Generating grub configuration file ... 2026-02-13T01:15:31.668 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-13T01:15:31.675 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-13T01:15:31.926 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T01:15:31.933 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T01:15:31.965 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T01:15:31.972 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T01:15:31.996 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T01:15:32.002 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T01:15:32.084 INFO:teuthology.orchestra.run.trial040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T01:15:32.091 INFO:teuthology.orchestra.run.trial040.stderr:done 2026-02-13T01:15:32.093 DEBUG:teuthology.orchestra.run.trial040:> test -d /sys/firmware/efi 2026-02-13T01:15:32.110 DEBUG:teuthology.orchestra.run.trial040:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T01:15:32.175 INFO:teuthology.orchestra.run.trial040.stdout:/boot/efi/EFI/BOOT 2026-02-13T01:15:32.175 INFO:teuthology.orchestra.run.trial040.stdout:/boot/efi/EFI/centos 2026-02-13T01:15:32.177 DEBUG:teuthology.orchestra.run.trial040:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T01:15:32.243 INFO:teuthology.orchestra.run.trial040.stdout:no 2026-02-13T01:15:32.244 DEBUG:teuthology.orchestra.run.trial040:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T01:15:32.308 INFO:teuthology.orchestra.run.trial040.stdout:yes 2026-02-13T01:15:32.308 DEBUG:teuthology.orchestra.run.trial040:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T01:15:32.373 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial040 2026-02-13T01:15:32.373 DEBUG:teuthology.orchestra.run.trial040:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T01:16:02.416 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-13T01:16:02.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-13T01:16:02.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:17:02.419 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T01:17:11.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-13T01:17:11.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:17:11.567 DEBUG:teuthology.orchestra.run.trial040:> true 2026-02-13T01:17:11.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-13T01:17:11.810 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.19.0-g8dec4b357aab"... 2026-02-13T01:17:11.810 DEBUG:teuthology.orchestra.run.trial040:> uname -r 2026-02-13T01:17:11.887 INFO:teuthology.orchestra.run.trial040.stdout:6.19.0-g8dec4b357aab 2026-02-13T01:17:11.887 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-13T01:17:11.887 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T01:17:11.887 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T01:17:12.891 DEBUG:teuthology.parallel:result is None 2026-02-13T01:17:12.891 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T01:17:12.904 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T01:17:12.904 DEBUG:teuthology.orchestra.run.trial040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T01:17:12.908 DEBUG:teuthology.orchestra.run.trial055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T01:17:12.911 DEBUG:teuthology.orchestra.run.trial118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T01:17:12.942 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T01:17:12.954 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T01:17:12.967 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T01:17:12.967 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T01:17:12.985 DEBUG:teuthology.orchestra.run.trial055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T01:17:12.987 DEBUG:teuthology.orchestra.run.trial118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T01:17:13.031 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T01:17:13.043 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T01:17:13.043 DEBUG:teuthology.orchestra.run.trial055:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T01:17:13.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:17:13.059 DEBUG:teuthology.orchestra.run.trial118:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T01:17:13.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:17:13.077 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T01:17:13.081 DEBUG:teuthology.orchestra.run.trial055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T01:17:13.101 DEBUG:teuthology.orchestra.run.trial118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T01:17:13.125 INFO:teuthology.orchestra.run.trial055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:17:13.133 INFO:teuthology.orchestra.run.trial055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:17:13.138 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:17:13.142 INFO:teuthology.orchestra.run.trial118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:17:13.151 INFO:teuthology.orchestra.run.trial118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:17:13.158 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:17:13.161 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T01:17:13.172 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T01:17:13.172 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T01:17:13.175 DEBUG:teuthology.orchestra.run.trial055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T01:17:13.177 DEBUG:teuthology.orchestra.run.trial118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T01:17:13.227 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T01:17:13.240 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T01:17:13.240 DEBUG:teuthology.orchestra.run.trial040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T01:17:13.243 DEBUG:teuthology.orchestra.run.trial055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T01:17:13.244 DEBUG:teuthology.orchestra.run.trial118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T01:17:13.276 DEBUG:teuthology.orchestra.run.trial040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:17:13.463 DEBUG:teuthology.orchestra.run.trial040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:17:13.520 DEBUG:teuthology.orchestra.run.trial040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:17:13.667 DEBUG:teuthology.orchestra.run.trial040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:17:13.723 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:17:13.723 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T01:17:13.779 DEBUG:teuthology.orchestra.run.trial055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:17:13.884 DEBUG:teuthology.orchestra.run.trial055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:17:13.909 DEBUG:teuthology.orchestra.run.trial055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:17:14.041 DEBUG:teuthology.orchestra.run.trial055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:17:14.065 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:17:14.066 DEBUG:teuthology.orchestra.run.trial055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T01:17:14.130 DEBUG:teuthology.orchestra.run.trial118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:17:14.239 DEBUG:teuthology.orchestra.run.trial118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:17:14.265 DEBUG:teuthology.orchestra.run.trial118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:17:14.413 DEBUG:teuthology.orchestra.run.trial118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:17:14.438 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:17:14.438 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T01:17:14.502 DEBUG:teuthology.orchestra.run.trial040:> sudo service rsyslog restart 2026-02-13T01:17:14.505 DEBUG:teuthology.orchestra.run.trial055:> sudo service rsyslog restart 2026-02-13T01:17:14.506 DEBUG:teuthology.orchestra.run.trial118:> sudo service rsyslog restart 2026-02-13T01:17:14.533 INFO:teuthology.orchestra.run.trial055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:17:14.566 INFO:teuthology.orchestra.run.trial040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:17:14.572 INFO:teuthology.orchestra.run.trial118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:17:15.091 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T01:17:15.104 INFO:teuthology.task.internal:Starting timer... 2026-02-13T01:17:15.104 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T01:17:15.127 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T01:17:15.141 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-13T01:17:15.141 DEBUG:teuthology.orchestra.run.trial040:> sudo service auditd rotate 2026-02-13T01:17:15.206 INFO:teuthology.orchestra.run.trial040.stdout:Rotating logs: 2026-02-13T01:17:15.209 DEBUG:teuthology.orchestra.run.trial055:> sudo service auditd rotate 2026-02-13T01:17:15.238 INFO:teuthology.orchestra.run.trial055.stdout:Rotating logs: 2026-02-13T01:17:15.240 DEBUG:teuthology.orchestra.run.trial118:> sudo service auditd rotate 2026-02-13T01:17:15.271 INFO:teuthology.orchestra.run.trial118.stdout:Rotating logs: 2026-02-13T01:17:15.272 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T01:17:15.273 DEBUG:teuthology.orchestra.run.trial040:> /usr/sbin/getenforce 2026-02-13T01:17:15.311 INFO:teuthology.orchestra.run.trial040.stdout:Permissive 2026-02-13T01:17:15.311 DEBUG:teuthology.orchestra.run.trial055:> /usr/sbin/getenforce 2026-02-13T01:17:15.329 INFO:teuthology.orchestra.run.trial055.stdout:Permissive 2026-02-13T01:17:15.329 DEBUG:teuthology.orchestra.run.trial118:> /usr/sbin/getenforce 2026-02-13T01:17:15.346 INFO:teuthology.orchestra.run.trial118.stdout:Permissive 2026-02-13T01:17:15.346 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial040.front.sepia.ceph.com': 'permissive', 'ubuntu@trial055.front.sepia.ceph.com': 'permissive', 'ubuntu@trial118.front.sepia.ceph.com': 'permissive'} 2026-02-13T01:17:15.346 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:17:15.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:17:15.408 DEBUG:teuthology.orchestra.run.trial055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:17:15.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:17:15.435 DEBUG:teuthology.orchestra.run.trial118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:17:15.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:17:15.462 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T01:17:15.462 DEBUG:teuthology.orchestra.run.trial040:> sudo /usr/sbin/setenforce permissive 2026-02-13T01:17:15.517 DEBUG:teuthology.orchestra.run.trial055:> sudo /usr/sbin/setenforce permissive 2026-02-13T01:17:15.543 DEBUG:teuthology.orchestra.run.trial118:> sudo /usr/sbin/setenforce permissive 2026-02-13T01:17:15.567 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T01:17:15.582 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T01:17:15.594 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T01:17:15.595 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial040.front.sepia.ceph.com,trial055.front.sepia.ceph.com,trial118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T01:19:12.279 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial040.front.sepia.ceph.com'), Remote(name='ubuntu@trial055.front.sepia.ceph.com'), Remote(name='ubuntu@trial118.front.sepia.ceph.com')] 2026-02-13T01:19:12.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-13T01:19:12.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:19:12.360 DEBUG:teuthology.orchestra.run.trial040:> true 2026-02-13T01:19:12.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-13T01:19:12.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial055.front.sepia.ceph.com' 2026-02-13T01:19:12.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:19:12.536 DEBUG:teuthology.orchestra.run.trial055:> true 2026-02-13T01:19:12.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial055.front.sepia.ceph.com' 2026-02-13T01:19:12.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-13T01:19:12.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:19:12.680 DEBUG:teuthology.orchestra.run.trial118:> true 2026-02-13T01:19:12.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-13T01:19:12.757 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T01:19:12.775 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T01:19:12.775 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T01:19:12.775 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:19:12.778 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T01:19:12.779 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:19:12.781 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T01:19:12.781 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:19:12.807 INFO:teuthology.orchestra.run.trial055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T01:19:12.818 INFO:teuthology.orchestra.run.trial055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T01:19:12.824 INFO:teuthology.orchestra.run.trial118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T01:19:12.834 INFO:teuthology.orchestra.run.trial040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T01:19:12.836 INFO:teuthology.orchestra.run.trial118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T01:19:12.839 INFO:teuthology.orchestra.run.trial055.stderr:sudo: ntpd: command not found 2026-02-13T01:19:12.849 INFO:teuthology.orchestra.run.trial055.stdout:506 Cannot talk to daemon 2026-02-13T01:19:12.856 INFO:teuthology.orchestra.run.trial118.stderr:sudo: ntpd: command not found 2026-02-13T01:19:12.859 INFO:teuthology.orchestra.run.trial040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T01:19:12.859 INFO:teuthology.orchestra.run.trial055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T01:19:12.866 INFO:teuthology.orchestra.run.trial118.stdout:506 Cannot talk to daemon 2026-02-13T01:19:12.871 INFO:teuthology.orchestra.run.trial055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T01:19:12.877 INFO:teuthology.orchestra.run.trial118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T01:19:12.888 INFO:teuthology.orchestra.run.trial118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T01:19:12.902 INFO:teuthology.orchestra.run.trial040.stderr:sudo: ntpd: command not found 2026-02-13T01:19:12.918 INFO:teuthology.orchestra.run.trial055.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:19:12.921 INFO:teuthology.orchestra.run.trial055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:19:12.921 INFO:teuthology.orchestra.run.trial055.stdout:=============================================================================== 2026-02-13T01:19:12.921 INFO:teuthology.orchestra.run.trial055.stdout:^? jane.qotw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:12.921 INFO:teuthology.orchestra.run.trial055.stdout:^? 50.218.103.254 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:12.921 INFO:teuthology.orchestra.run.trial055.stdout:^? kjsl-fmt2-net.fmt2.kjsl.> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:12.921 INFO:teuthology.orchestra.run.trial055.stdout:^? ntp.sfo.icanbwell.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:12.924 INFO:teuthology.orchestra.run.trial040.stdout:506 Cannot talk to daemon 2026-02-13T01:19:12.933 INFO:teuthology.orchestra.run.trial118.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:19:12.936 INFO:teuthology.orchestra.run.trial118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:19:12.936 INFO:teuthology.orchestra.run.trial118.stdout:=============================================================================== 2026-02-13T01:19:12.936 INFO:teuthology.orchestra.run.trial118.stdout:^? dns-e.ns4v.icu 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:12.936 INFO:teuthology.orchestra.run.trial118.stdout:^? 163-123-152-14.ip4.evals> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:12.936 INFO:teuthology.orchestra.run.trial118.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:12.936 INFO:teuthology.orchestra.run.trial118.stdout:^? ntp0.alb1.inoc.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:12.947 INFO:teuthology.orchestra.run.trial040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T01:19:12.973 INFO:teuthology.orchestra.run.trial040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T01:19:13.048 INFO:teuthology.orchestra.run.trial040.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:19:13.053 INFO:teuthology.orchestra.run.trial040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:19:13.053 INFO:teuthology.orchestra.run.trial040.stdout:=============================================================================== 2026-02-13T01:19:13.053 INFO:teuthology.orchestra.run.trial040.stdout:^? ntp1.lax.us.hojmark.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:13.053 INFO:teuthology.orchestra.run.trial040.stdout:^? 192-210-133-204-host.col> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:13.053 INFO:teuthology.orchestra.run.trial040.stdout:^? 172-234-44-141.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:13.053 INFO:teuthology.orchestra.run.trial040.stdout:^? ntp2.wiktel.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:19:13.054 INFO:teuthology.run_tasks:Running task pexec... 2026-02-13T01:19:13.066 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-13T01:19:13.067 DEBUG:teuthology.orchestra.run.trial040:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T01:19:13.067 DEBUG:teuthology.orchestra.run.trial055:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T01:19:13.067 DEBUG:teuthology.orchestra.run.trial118:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T01:19:13.069 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial055.front.sepia.ceph.com 2026-02-13T01:19:13.069 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T01:19:13.069 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T01:19:13.070 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial118.front.sepia.ceph.com 2026-02-13T01:19:13.070 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T01:19:13.070 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T01:19:13.070 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial040.front.sepia.ceph.com 2026-02-13T01:19:13.070 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T01:19:13.070 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T01:19:13.235 INFO:teuthology.orchestra.run.trial055.stdout:No match for argument: nvme-cli 2026-02-13T01:19:13.236 INFO:teuthology.orchestra.run.trial055.stderr:No packages marked for removal. 2026-02-13T01:19:13.236 INFO:teuthology.orchestra.run.trial118.stdout:No match for argument: nvme-cli 2026-02-13T01:19:13.236 INFO:teuthology.orchestra.run.trial118.stderr:No packages marked for removal. 2026-02-13T01:19:13.237 INFO:teuthology.orchestra.run.trial055.stdout:Dependencies resolved. 2026-02-13T01:19:13.238 INFO:teuthology.orchestra.run.trial055.stdout:Nothing to do. 2026-02-13T01:19:13.238 INFO:teuthology.orchestra.run.trial055.stdout:Complete! 2026-02-13T01:19:13.239 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-13T01:19:13.239 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-13T01:19:13.239 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-13T01:19:13.306 INFO:teuthology.orchestra.run.trial040.stdout:No match for argument: nvme-cli 2026-02-13T01:19:13.307 INFO:teuthology.orchestra.run.trial040.stderr:No packages marked for removal. 2026-02-13T01:19:13.309 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-13T01:19:13.310 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-13T01:19:13.310 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-13T01:19:13.526 INFO:teuthology.orchestra.run.trial055.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Feb 2026 01:18:22 AM UTC. 2026-02-13T01:19:13.533 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:33 ago on Fri 13 Feb 2026 01:18:40 AM UTC. 2026-02-13T01:19:13.607 INFO:teuthology.orchestra.run.trial055.stdout:Dependencies resolved. 2026-02-13T01:19:13.608 INFO:teuthology.orchestra.run.trial055.stdout:================================================================================ 2026-02-13T01:19:13.608 INFO:teuthology.orchestra.run.trial055.stdout: Package Architecture Version Repository Size 2026-02-13T01:19:13.608 INFO:teuthology.orchestra.run.trial055.stdout:================================================================================ 2026-02-13T01:19:13.608 INFO:teuthology.orchestra.run.trial055.stdout:Installing: 2026-02-13T01:19:13.608 INFO:teuthology.orchestra.run.trial055.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T01:19:13.608 INFO:teuthology.orchestra.run.trial055.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T01:19:13.608 INFO:teuthology.orchestra.run.trial055.stdout:Upgrading: 2026-02-13T01:19:13.608 INFO:teuthology.orchestra.run.trial055.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T01:19:13.608 INFO:teuthology.orchestra.run.trial055.stdout:Installing dependencies: 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout:Transaction Summary 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout:================================================================================ 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout:Install 6 Packages 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout:Upgrade 1 Package 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout:Total download size: 2.4 M 2026-02-13T01:19:13.609 INFO:teuthology.orchestra.run.trial055.stdout:Downloading Packages: 2026-02-13T01:19:13.613 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-13T01:19:13.615 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-13T01:19:13.615 INFO:teuthology.orchestra.run.trial118.stdout: Package Architecture Version Repository Size 2026-02-13T01:19:13.615 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-13T01:19:13.615 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-13T01:19:13.615 INFO:teuthology.orchestra.run.trial118.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T01:19:13.615 INFO:teuthology.orchestra.run.trial118.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout:Upgrading: 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout:Installing dependencies: 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout:Install 6 Packages 2026-02-13T01:19:13.616 INFO:teuthology.orchestra.run.trial118.stdout:Upgrade 1 Package 2026-02-13T01:19:13.617 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:19:13.617 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 2.4 M 2026-02-13T01:19:13.617 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-13T01:19:13.700 INFO:teuthology.orchestra.run.trial055.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 1.4 MB/s | 44 kB 00:00 2026-02-13T01:19:13.703 INFO:teuthology.orchestra.run.trial055.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 2.1 MB/s | 72 kB 00:00 2026-02-13T01:19:13.717 INFO:teuthology.orchestra.run.trial055.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 4.8 MB/s | 84 kB 00:00 2026-02-13T01:19:13.722 INFO:teuthology.orchestra.run.trial055.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 7.7 MB/s | 150 kB 00:00 2026-02-13T01:19:13.732 INFO:teuthology.orchestra.run.trial055.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 11 MB/s | 116 kB 00:00 2026-02-13T01:19:13.736 INFO:teuthology.orchestra.run.trial055.stdout:(6/7): nvme-cli-2.16-1.el9.x86_64.rpm 17 MB/s | 1.2 MB 00:00 2026-02-13T01:19:13.749 INFO:teuthology.orchestra.run.trial055.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 26 MB/s | 837 kB 00:00 2026-02-13T01:19:13.749 INFO:teuthology.orchestra.run.trial055.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:19:13.749 INFO:teuthology.orchestra.run.trial055.stdout:Total 17 MB/s | 2.4 MB 00:00 2026-02-13T01:19:13.771 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:01:07 ago on Fri 13 Feb 2026 01:18:06 AM UTC. 2026-02-13T01:19:13.810 INFO:teuthology.orchestra.run.trial055.stdout:Running transaction check 2026-02-13T01:19:13.818 INFO:teuthology.orchestra.run.trial055.stdout:Transaction check succeeded. 2026-02-13T01:19:13.818 INFO:teuthology.orchestra.run.trial055.stdout:Running transaction test 2026-02-13T01:19:13.861 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: Package Architecture Version Repository Size 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout:Upgrading: 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout:Installing dependencies: 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout:Install 6 Packages 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout:Upgrade 1 Package 2026-02-13T01:19:13.862 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:19:13.863 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 2.4 M 2026-02-13T01:19:13.863 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-13T01:19:13.877 INFO:teuthology.orchestra.run.trial055.stdout:Transaction test succeeded. 2026-02-13T01:19:13.878 INFO:teuthology.orchestra.run.trial055.stdout:Running transaction 2026-02-13T01:19:13.946 INFO:teuthology.orchestra.run.trial055.stdout: Preparing : 1/1 2026-02-13T01:19:14.014 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T01:19:14.021 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T01:19:14.031 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T01:19:14.036 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T01:19:14.042 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T01:19:14.043 INFO:teuthology.orchestra.run.trial055.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:19:14.173 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:19:14.176 INFO:teuthology.orchestra.run.trial055.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:19:14.260 INFO:teuthology.orchestra.run.trial118.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 75 kB/s | 44 kB 00:00 2026-02-13T01:19:14.314 INFO:teuthology.orchestra.run.trial118.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 112 kB/s | 72 kB 00:00 2026-02-13T01:19:14.454 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:19:14.454 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T01:19:14.454 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:19:14.475 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:19:14.523 INFO:teuthology.orchestra.run.trial040.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 74 kB/s | 44 kB 00:00 2026-02-13T01:19:14.579 INFO:teuthology.orchestra.run.trial040.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 110 kB/s | 72 kB 00:00 2026-02-13T01:19:14.610 INFO:teuthology.orchestra.run.trial118.stdout:(3/7): nvme-cli-2.16-1.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:00 2026-02-13T01:19:14.687 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:19:14.687 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T01:19:14.687 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T01:19:14.687 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T01:19:14.688 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T01:19:14.688 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T01:19:14.688 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T01:19:14.688 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T01:19:14.738 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:19:14.738 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:19:14.738 INFO:teuthology.orchestra.run.trial055.stdout:Upgraded: 2026-02-13T01:19:14.738 INFO:teuthology.orchestra.run.trial055.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T01:19:14.738 INFO:teuthology.orchestra.run.trial055.stdout:Installed: 2026-02-13T01:19:14.739 INFO:teuthology.orchestra.run.trial055.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T01:19:14.739 INFO:teuthology.orchestra.run.trial055.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T01:19:14.739 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T01:19:14.739 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:19:14.739 INFO:teuthology.orchestra.run.trial055.stdout:Complete! 2026-02-13T01:19:14.771 DEBUG:teuthology.parallel:result is None 2026-02-13T01:19:14.868 INFO:teuthology.orchestra.run.trial040.stdout:(3/7): nvme-cli-2.16-1.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:00 2026-02-13T01:19:14.907 INFO:teuthology.orchestra.run.trial118.stdout:(4/7): python3-kmod-0.9-32.el9.x86_64.rpm 130 kB/s | 84 kB 00:00 2026-02-13T01:19:15.040 INFO:teuthology.orchestra.run.trial118.stdout:(5/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 207 kB/s | 150 kB 00:00 2026-02-13T01:19:15.302 INFO:teuthology.orchestra.run.trial040.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 208 kB/s | 150 kB 00:00 2026-02-13T01:19:15.426 INFO:teuthology.orchestra.run.trial040.stdout:(5/7): python3-kmod-0.9-32.el9.x86_64.rpm 93 kB/s | 84 kB 00:00 2026-02-13T01:19:15.509 INFO:teuthology.orchestra.run.trial118.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 932 kB/s | 837 kB 00:00 2026-02-13T01:19:15.602 INFO:teuthology.orchestra.run.trial118.stdout:(7/7): libnvme-1.16.1-2.el9.x86_64.rpm 167 kB/s | 116 kB 00:00 2026-02-13T01:19:15.603 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:19:15.603 INFO:teuthology.orchestra.run.trial118.stdout:Total 1.2 MB/s | 2.4 MB 00:01 2026-02-13T01:19:15.667 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-13T01:19:15.674 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-13T01:19:15.674 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-13T01:19:15.732 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-13T01:19:15.732 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-13T01:19:15.775 INFO:teuthology.orchestra.run.trial040.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 923 kB/s | 837 kB 00:00 2026-02-13T01:19:15.800 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-13T01:19:15.868 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T01:19:15.875 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T01:19:15.884 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T01:19:15.889 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T01:19:15.895 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T01:19:15.896 INFO:teuthology.orchestra.run.trial118.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:19:15.988 INFO:teuthology.orchestra.run.trial040.stdout:(7/7): libnvme-1.16.1-2.el9.x86_64.rpm 169 kB/s | 116 kB 00:00 2026-02-13T01:19:15.989 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:19:15.989 INFO:teuthology.orchestra.run.trial040.stdout:Total 1.1 MB/s | 2.4 MB 00:02 2026-02-13T01:19:16.024 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:19:16.027 INFO:teuthology.orchestra.run.trial118.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:19:16.099 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-13T01:19:16.110 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-13T01:19:16.110 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-13T01:19:16.196 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-13T01:19:16.197 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-13T01:19:16.285 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-13T01:19:16.308 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:19:16.308 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T01:19:16.308 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:19:16.331 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:19:16.378 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T01:19:16.394 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T01:19:16.407 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T01:19:16.416 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T01:19:16.426 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T01:19:16.428 INFO:teuthology.orchestra.run.trial040.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:19:16.551 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:19:16.551 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T01:19:16.551 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T01:19:16.551 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T01:19:16.551 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T01:19:16.551 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T01:19:16.551 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T01:19:16.551 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout:Upgraded: 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:19:16.598 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-13T01:19:16.622 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:19:16.629 DEBUG:teuthology.parallel:result is None 2026-02-13T01:19:16.629 INFO:teuthology.orchestra.run.trial040.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:19:17.181 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:19:17.181 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T01:19:17.181 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:19:17.203 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:19:17.587 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:19:17.588 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T01:19:17.588 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T01:19:17.588 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T01:19:17.588 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T01:19:17.588 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T01:19:17.588 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T01:19:17.588 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T01:19:17.649 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:19:17.649 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:19:17.649 INFO:teuthology.orchestra.run.trial040.stdout:Upgraded: 2026-02-13T01:19:17.649 INFO:teuthology.orchestra.run.trial040.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T01:19:17.649 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-13T01:19:17.649 INFO:teuthology.orchestra.run.trial040.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T01:19:17.649 INFO:teuthology.orchestra.run.trial040.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T01:19:17.650 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T01:19:17.650 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:19:17.650 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-13T01:19:17.706 DEBUG:teuthology.parallel:result is None 2026-02-13T01:19:17.706 INFO:teuthology.run_tasks:Running task install... 2026-02-13T01:19:17.720 DEBUG:teuthology.task.install:project ceph 2026-02-13T01:19:17.720 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}} 2026-02-13T01:19:17.720 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'} 2026-02-13T01:19:17.720 INFO:teuthology.task.install:Using flavor: default 2026-02-13T01:19:17.729 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T01:19:17.730 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-13T01:19:17.730 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T01:19:17.731 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:19:17.734 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T01:19:17.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:19:17.736 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T01:19:17.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:19:17.976 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T01:19:17.976 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T01:19:17.978 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T01:19:17.978 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T01:19:17.984 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T01:19:17.984 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T01:19:18.181 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T01:19:18.181 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:19:18.181 DEBUG:teuthology.orchestra.run.trial055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T01:19:18.192 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T01:19:18.192 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:19:18.192 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T01:19:18.210 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T01:19:18.210 DEBUG:teuthology.orchestra.run.trial055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T01:19:18.247 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T01:19:18.247 DEBUG:teuthology.orchestra.run.trial040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T01:19:18.276 DEBUG:teuthology.orchestra.run.trial055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T01:19:18.316 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T01:19:18.316 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:19:18.316 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T01:19:18.343 DEBUG:teuthology.orchestra.run.trial040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T01:19:18.346 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T01:19:18.347 DEBUG:teuthology.orchestra.run.trial118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T01:19:18.349 DEBUG:teuthology.orchestra.run.trial055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T01:19:18.411 DEBUG:teuthology.orchestra.run.trial118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T01:19:18.413 INFO:teuthology.orchestra.run.trial055.stdout:check_obsoletes = 1 2026-02-13T01:19:18.414 DEBUG:teuthology.orchestra.run.trial055:> sudo yum clean all 2026-02-13T01:19:18.424 DEBUG:teuthology.orchestra.run.trial040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T01:19:18.479 INFO:teuthology.orchestra.run.trial040.stdout:check_obsoletes = 1 2026-02-13T01:19:18.483 DEBUG:teuthology.orchestra.run.trial040:> sudo yum clean all 2026-02-13T01:19:18.486 DEBUG:teuthology.orchestra.run.trial118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T01:19:18.551 INFO:teuthology.orchestra.run.trial118.stdout:check_obsoletes = 1 2026-02-13T01:19:18.552 DEBUG:teuthology.orchestra.run.trial118:> sudo yum clean all 2026-02-13T01:19:18.571 INFO:teuthology.orchestra.run.trial055.stdout:41 files removed 2026-02-13T01:19:18.585 DEBUG:teuthology.orchestra.run.trial055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T01:19:18.654 INFO:teuthology.orchestra.run.trial040.stdout:41 files removed 2026-02-13T01:19:18.672 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T01:19:18.712 INFO:teuthology.orchestra.run.trial118.stdout:41 files removed 2026-02-13T01:19:18.726 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T01:19:18.860 INFO:teuthology.orchestra.run.trial055.stdout:ceph packages for x86_64 680 kB/s | 91 kB 00:00 2026-02-13T01:19:18.996 INFO:teuthology.orchestra.run.trial118.stdout:ceph packages for x86_64 711 kB/s | 91 kB 00:00 2026-02-13T01:19:18.997 INFO:teuthology.orchestra.run.trial055.stdout:ceph noarch packages 203 kB/s | 23 kB 00:00 2026-02-13T01:19:19.042 INFO:teuthology.orchestra.run.trial040.stdout:ceph packages for x86_64 660 kB/s | 91 kB 00:00 2026-02-13T01:19:19.118 INFO:teuthology.orchestra.run.trial055.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T01:19:19.131 INFO:teuthology.orchestra.run.trial118.stdout:ceph noarch packages 205 kB/s | 23 kB 00:00 2026-02-13T01:19:19.189 INFO:teuthology.orchestra.run.trial040.stdout:ceph noarch packages 191 kB/s | 23 kB 00:00 2026-02-13T01:19:19.251 INFO:teuthology.orchestra.run.trial118.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T01:19:19.316 INFO:teuthology.orchestra.run.trial040.stdout:ceph source packages 19 kB/s | 2.1 kB 00:00 2026-02-13T01:19:20.082 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-13T01:19:20.084 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-13T01:19:20.280 INFO:teuthology.orchestra.run.trial055.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 8.9 MB 00:01 2026-02-13T01:19:22.595 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - AppStream 14 MB/s | 27 MB 00:01 2026-02-13T01:19:23.155 INFO:teuthology.orchestra.run.trial055.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T01:19:23.168 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T01:19:26.491 INFO:teuthology.orchestra.run.trial055.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 7.8 MB 00:00 2026-02-13T01:19:26.747 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 7.8 MB 00:01 2026-02-13T01:19:27.811 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 20 kB 00:00 2026-02-13T01:19:28.016 INFO:teuthology.orchestra.run.trial055.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 20 kB 00:00 2026-02-13T01:19:28.461 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 7.8 MB 00:03 2026-02-13T01:19:28.634 INFO:teuthology.orchestra.run.trial118.stdout:Extra Packages for Enterprise Linux 27 MB/s | 20 MB 00:00 2026-02-13T01:19:29.396 INFO:teuthology.orchestra.run.trial055.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-13T01:19:30.282 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-13T01:19:31.770 INFO:teuthology.orchestra.run.trial040.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-13T01:19:31.909 INFO:teuthology.orchestra.run.trial118.stdout:lab-extras 741 kB/s | 50 kB 00:00 2026-02-13T01:19:32.668 INFO:teuthology.orchestra.run.trial055.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T01:19:33.175 INFO:teuthology.orchestra.run.trial118.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:19:33.176 INFO:teuthology.orchestra.run.trial118.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:19:33.181 INFO:teuthology.orchestra.run.trial118.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T01:19:33.182 INFO:teuthology.orchestra.run.trial118.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T01:19:33.182 INFO:teuthology.orchestra.run.trial118.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T01:19:33.182 INFO:teuthology.orchestra.run.trial118.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T01:19:33.183 INFO:teuthology.orchestra.run.trial118.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T01:19:33.184 INFO:teuthology.orchestra.run.trial118.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T01:19:33.185 INFO:teuthology.orchestra.run.trial118.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T01:19:33.212 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-13T01:19:33.216 INFO:teuthology.orchestra.run.trial118.stdout:======================================================================================= 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout: Package Arch Version Repository Size 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout:======================================================================================= 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T01:19:33.217 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T01:19:33.218 INFO:teuthology.orchestra.run.trial118.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T01:19:33.219 INFO:teuthology.orchestra.run.trial118.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout:Upgrading: 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T01:19:33.220 INFO:teuthology.orchestra.run.trial118.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout:Installing dependencies: 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T01:19:33.221 INFO:teuthology.orchestra.run.trial118.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T01:19:33.222 INFO:teuthology.orchestra.run.trial118.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T01:19:33.223 INFO:teuthology.orchestra.run.trial118.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T01:19:33.224 INFO:teuthology.orchestra.run.trial118.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T01:19:33.225 INFO:teuthology.orchestra.run.trial118.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T01:19:33.226 INFO:teuthology.orchestra.run.trial118.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T01:19:33.227 INFO:teuthology.orchestra.run.trial118.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T01:19:33.228 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T01:19:33.229 INFO:teuthology.orchestra.run.trial118.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T01:19:33.230 INFO:teuthology.orchestra.run.trial118.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout:Installing weak dependencies: 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout:======================================================================================= 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout:Install 162 Packages 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout:Upgrade 11 Packages 2026-02-13T01:19:33.231 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:19:33.232 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 302 M 2026-02-13T01:19:33.232 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-13T01:19:33.910 INFO:teuthology.orchestra.run.trial118.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 92 kB/s | 6.5 kB 00:00 2026-02-13T01:19:33.930 INFO:teuthology.orchestra.run.trial055.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:19:33.930 INFO:teuthology.orchestra.run.trial055.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:19:33.936 INFO:teuthology.orchestra.run.trial055.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T01:19:33.937 INFO:teuthology.orchestra.run.trial055.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T01:19:33.937 INFO:teuthology.orchestra.run.trial055.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T01:19:33.938 INFO:teuthology.orchestra.run.trial055.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T01:19:33.938 INFO:teuthology.orchestra.run.trial055.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T01:19:33.940 INFO:teuthology.orchestra.run.trial055.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T01:19:33.940 INFO:teuthology.orchestra.run.trial055.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T01:19:33.967 INFO:teuthology.orchestra.run.trial055.stdout:Dependencies resolved. 2026-02-13T01:19:33.972 INFO:teuthology.orchestra.run.trial055.stdout:======================================================================================= 2026-02-13T01:19:33.972 INFO:teuthology.orchestra.run.trial055.stdout: Package Arch Version Repository Size 2026-02-13T01:19:33.972 INFO:teuthology.orchestra.run.trial055.stdout:======================================================================================= 2026-02-13T01:19:33.972 INFO:teuthology.orchestra.run.trial055.stdout:Installing: 2026-02-13T01:19:33.972 INFO:teuthology.orchestra.run.trial055.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T01:19:33.973 INFO:teuthology.orchestra.run.trial055.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T01:19:33.974 INFO:teuthology.orchestra.run.trial055.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T01:19:33.975 INFO:teuthology.orchestra.run.trial055.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T01:19:33.975 INFO:teuthology.orchestra.run.trial055.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T01:19:33.975 INFO:teuthology.orchestra.run.trial055.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T01:19:33.975 INFO:teuthology.orchestra.run.trial055.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T01:19:33.975 INFO:teuthology.orchestra.run.trial055.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T01:19:33.975 INFO:teuthology.orchestra.run.trial055.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T01:19:33.975 INFO:teuthology.orchestra.run.trial055.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T01:19:33.975 INFO:teuthology.orchestra.run.trial055.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T01:19:33.975 INFO:teuthology.orchestra.run.trial055.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout:Upgrading: 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T01:19:33.976 INFO:teuthology.orchestra.run.trial055.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout:Installing dependencies: 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T01:19:33.977 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T01:19:33.978 INFO:teuthology.orchestra.run.trial055.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T01:19:33.979 INFO:teuthology.orchestra.run.trial055.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T01:19:33.980 INFO:teuthology.orchestra.run.trial055.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T01:19:33.981 INFO:teuthology.orchestra.run.trial055.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T01:19:33.982 INFO:teuthology.orchestra.run.trial055.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T01:19:33.983 INFO:teuthology.orchestra.run.trial055.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T01:19:33.984 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T01:19:33.985 INFO:teuthology.orchestra.run.trial055.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T01:19:33.986 INFO:teuthology.orchestra.run.trial055.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T01:19:33.987 INFO:teuthology.orchestra.run.trial055.stdout:Installing weak dependencies: 2026-02-13T01:19:33.987 INFO:teuthology.orchestra.run.trial055.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T01:19:33.987 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:19:33.987 INFO:teuthology.orchestra.run.trial055.stdout:Transaction Summary 2026-02-13T01:19:33.987 INFO:teuthology.orchestra.run.trial055.stdout:======================================================================================= 2026-02-13T01:19:33.987 INFO:teuthology.orchestra.run.trial055.stdout:Install 162 Packages 2026-02-13T01:19:33.987 INFO:teuthology.orchestra.run.trial055.stdout:Upgrade 11 Packages 2026-02-13T01:19:33.987 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:19:33.988 INFO:teuthology.orchestra.run.trial055.stdout:Total download size: 302 M 2026-02-13T01:19:33.988 INFO:teuthology.orchestra.run.trial055.stdout:Downloading Packages: 2026-02-13T01:19:34.008 INFO:teuthology.orchestra.run.trial118.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 9.8 MB/s | 987 kB 00:00 2026-02-13T01:19:34.031 INFO:teuthology.orchestra.run.trial118.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 6.3 MB/s | 147 kB 00:00 2026-02-13T01:19:34.167 INFO:teuthology.orchestra.run.trial118.stdout:(4/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 16 MB/s | 5.2 MB 00:00 2026-02-13T01:19:34.178 INFO:teuthology.orchestra.run.trial118.stdout:(5/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 16 MB/s | 2.4 MB 00:00 2026-02-13T01:19:34.223 INFO:teuthology.orchestra.run.trial118.stdout:(6/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 16 MB/s | 940 kB 00:00 2026-02-13T01:19:34.252 INFO:teuthology.orchestra.run.trial118.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 5.6 MB/s | 166 kB 00:00 2026-02-13T01:19:34.413 INFO:teuthology.orchestra.run.trial055.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 38 kB/s | 6.5 kB 00:00 2026-02-13T01:19:34.453 INFO:teuthology.orchestra.run.trial118.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 18 MB/s | 5.0 MB 00:00 2026-02-13T01:19:35.069 INFO:teuthology.orchestra.run.trial118.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 20 MB/s | 24 MB 00:01 2026-02-13T01:19:35.151 INFO:teuthology.orchestra.run.trial118.stdout:(10/173): ceph-osd-classic-20.3.0-5241.g8f8d382 17 MB/s | 16 MB 00:00 2026-02-13T01:19:35.192 INFO:teuthology.orchestra.run.trial118.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 606 kB/s | 25 kB 00:00 2026-02-13T01:19:35.360 INFO:teuthology.orchestra.run.trial055.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.0 MB/s | 987 kB 00:00 2026-02-13T01:19:35.529 INFO:teuthology.orchestra.run.trial055.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 870 kB/s | 147 kB 00:00 2026-02-13T01:19:35.621 INFO:teuthology.orchestra.run.trial118.stdout:(12/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 16 MB/s | 19 MB 00:01 2026-02-13T01:19:35.670 INFO:teuthology.orchestra.run.trial118.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 4.8 MB/s | 243 kB 00:00 2026-02-13T01:19:35.717 INFO:teuthology.orchestra.run.trial118.stdout:(14/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 20 MB/s | 13 MB 00:00 2026-02-13T01:19:35.717 INFO:teuthology.orchestra.run.trial118.stdout:(15/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 584 kB/s | 27 kB 00:00 2026-02-13T01:19:35.740 INFO:teuthology.orchestra.run.trial118.stdout:(16/173): libcephfs-devel-20.3.0-5241.g8f8d3829 1.5 MB/s | 37 kB 00:00 2026-02-13T01:19:35.741 INFO:teuthology.orchestra.run.trial118.stdout:(17/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 1.0 MB/s | 24 kB 00:00 2026-02-13T01:19:35.781 INFO:teuthology.orchestra.run.trial118.stdout:(18/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 22 MB/s | 909 kB 00:00 2026-02-13T01:19:35.784 INFO:teuthology.orchestra.run.trial118.stdout:(19/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 3.6 MB/s | 159 kB 00:00 2026-02-13T01:19:35.808 INFO:teuthology.orchestra.run.trial118.stdout:(20/173): librados-devel-20.3.0-5241.g8f8d3829. 4.5 MB/s | 123 kB 00:00 2026-02-13T01:19:35.814 INFO:teuthology.orchestra.run.trial118.stdout:(21/173): libradosstriper1-20.3.0-5241.g8f8d382 8.1 MB/s | 248 kB 00:00 2026-02-13T01:19:35.861 INFO:teuthology.orchestra.run.trial118.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 948 kB/s | 45 kB 00:00 2026-02-13T01:19:35.909 INFO:teuthology.orchestra.run.trial118.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 3.8 MB/s | 185 kB 00:00 2026-02-13T01:19:35.959 INFO:teuthology.orchestra.run.trial118.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 4.0 MB/s | 204 kB 00:00 2026-02-13T01:19:36.012 INFO:teuthology.orchestra.run.trial118.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 6.0 MB/s | 324 kB 00:00 2026-02-13T01:19:36.062 INFO:teuthology.orchestra.run.trial040.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-13T01:19:36.064 INFO:teuthology.orchestra.run.trial118.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 5.7 MB/s | 306 kB 00:00 2026-02-13T01:19:36.100 INFO:teuthology.orchestra.run.trial118.stdout:(27/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 22 MB/s | 6.5 MB 00:00 2026-02-13T01:19:36.105 INFO:teuthology.orchestra.run.trial118.stdout:(28/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 2.4 MB/s | 100 kB 00:00 2026-02-13T01:19:36.129 INFO:teuthology.orchestra.run.trial118.stdout:(29/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 2.8 MB/s | 84 kB 00:00 2026-02-13T01:19:36.171 INFO:teuthology.orchestra.run.trial118.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 4.0 MB/s | 172 kB 00:00 2026-02-13T01:19:36.211 INFO:teuthology.orchestra.run.trial118.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.4 MB/s | 57 kB 00:00 2026-02-13T01:19:36.255 INFO:teuthology.orchestra.run.trial118.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 4.1 MB/s | 183 kB 00:00 2026-02-13T01:19:36.259 INFO:teuthology.orchestra.run.trial118.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 19 MB/s | 2.9 MB 00:00 2026-02-13T01:19:36.280 INFO:teuthology.orchestra.run.trial055.stdout:(4/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 2.6 MB/s | 5.2 MB 00:02 2026-02-13T01:19:36.705 INFO:teuthology.orchestra.run.trial055.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 2.2 MB/s | 940 kB 00:00 2026-02-13T01:19:36.756 INFO:teuthology.orchestra.run.trial118.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 15 MB/s | 7.4 MB 00:00 2026-02-13T01:19:36.809 INFO:teuthology.orchestra.run.trial118.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 5.4 MB/s | 297 kB 00:00 2026-02-13T01:19:36.858 INFO:teuthology.orchestra.run.trial118.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 1.0 MB/s | 50 kB 00:00 2026-02-13T01:19:36.909 INFO:teuthology.orchestra.run.trial118.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 341 kB/s | 17 kB 00:00 2026-02-13T01:19:36.965 INFO:teuthology.orchestra.run.trial118.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 5.3 MB/s | 299 kB 00:00 2026-02-13T01:19:36.991 INFO:teuthology.orchestra.run.trial118.stdout:(39/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 20 MB/s | 15 MB 00:00 2026-02-13T01:19:37.019 INFO:teuthology.orchestra.run.trial055.stdout:(6/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 1.6 MB/s | 2.4 MB 00:01 2026-02-13T01:19:37.037 INFO:teuthology.orchestra.run.trial118.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 394 kB/s | 18 kB 00:00 2026-02-13T01:19:37.043 INFO:teuthology.orchestra.run.trial118.stdout:(41/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 13 MB/s | 1.0 MB 00:00 2026-02-13T01:19:37.076 INFO:teuthology.orchestra.run.trial055.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 2.9 MB/s | 166 kB 00:00 2026-02-13T01:19:37.402 INFO:teuthology.orchestra.run.trial040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:19:37.402 INFO:teuthology.orchestra.run.trial040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:19:37.408 INFO:teuthology.orchestra.run.trial040.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T01:19:37.408 INFO:teuthology.orchestra.run.trial040.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T01:19:37.409 INFO:teuthology.orchestra.run.trial040.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T01:19:37.409 INFO:teuthology.orchestra.run.trial040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T01:19:37.410 INFO:teuthology.orchestra.run.trial040.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T01:19:37.411 INFO:teuthology.orchestra.run.trial040.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T01:19:37.412 INFO:teuthology.orchestra.run.trial040.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T01:19:37.442 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-13T01:19:37.447 INFO:teuthology.orchestra.run.trial040.stdout:======================================================================================= 2026-02-13T01:19:37.447 INFO:teuthology.orchestra.run.trial040.stdout: Package Arch Version Repository Size 2026-02-13T01:19:37.447 INFO:teuthology.orchestra.run.trial040.stdout:======================================================================================= 2026-02-13T01:19:37.447 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-13T01:19:37.447 INFO:teuthology.orchestra.run.trial040.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T01:19:37.447 INFO:teuthology.orchestra.run.trial040.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T01:19:37.447 INFO:teuthology.orchestra.run.trial040.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T01:19:37.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T01:19:37.449 INFO:teuthology.orchestra.run.trial040.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T01:19:37.450 INFO:teuthology.orchestra.run.trial040.stdout:Upgrading: 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout:Installing dependencies: 2026-02-13T01:19:37.451 INFO:teuthology.orchestra.run.trial040.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T01:19:37.452 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T01:19:37.453 INFO:teuthology.orchestra.run.trial040.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T01:19:37.454 INFO:teuthology.orchestra.run.trial040.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T01:19:37.455 INFO:teuthology.orchestra.run.trial040.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T01:19:37.456 INFO:teuthology.orchestra.run.trial040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T01:19:37.457 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T01:19:37.458 INFO:teuthology.orchestra.run.trial040.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T01:19:37.459 INFO:teuthology.orchestra.run.trial040.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T01:19:37.460 INFO:teuthology.orchestra.run.trial040.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout:Installing weak dependencies: 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout:======================================================================================= 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout:Install 162 Packages 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout:Upgrade 11 Packages 2026-02-13T01:19:37.461 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:19:37.462 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 302 M 2026-02-13T01:19:37.462 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-13T01:19:37.709 INFO:teuthology.orchestra.run.trial055.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 5.0 MB/s | 5.0 MB 00:01 2026-02-13T01:19:37.851 INFO:teuthology.orchestra.run.trial118.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 431 kB/s | 350 kB 00:00 2026-02-13T01:19:38.073 INFO:teuthology.orchestra.run.trial118.stdout:(43/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 27 MB/s | 78 MB 00:02 2026-02-13T01:19:38.079 INFO:teuthology.orchestra.run.trial118.stdout:(44/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.0 MB/s | 2.1 MB 00:01 2026-02-13T01:19:38.092 INFO:teuthology.orchestra.run.trial040.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 124 kB/s | 6.5 kB 00:00 2026-02-13T01:19:38.254 INFO:teuthology.orchestra.run.trial040.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 6.0 MB/s | 987 kB 00:00 2026-02-13T01:19:38.282 INFO:teuthology.orchestra.run.trial040.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 5.1 MB/s | 147 kB 00:00 2026-02-13T01:19:38.496 INFO:teuthology.orchestra.run.trial118.stdout:(45/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 63 kB/s | 40 kB 00:00 2026-02-13T01:19:38.548 INFO:teuthology.orchestra.run.trial040.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 8.9 MB/s | 2.4 MB 00:00 2026-02-13T01:19:38.616 INFO:teuthology.orchestra.run.trial118.stdout:(46/173): libatomic-11.5.0-14.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2026-02-13T01:19:38.638 INFO:teuthology.orchestra.run.trial040.stdout:(5/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 8.7 MB/s | 5.2 MB 00:00 2026-02-13T01:19:38.659 INFO:teuthology.orchestra.run.trial040.stdout:(6/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 8.3 MB/s | 940 kB 00:00 2026-02-13T01:19:38.711 INFO:teuthology.orchestra.run.trial118.stdout:(47/173): libconfig-1.7.2-9.el9.x86_64.rpm 114 kB/s | 72 kB 00:00 2026-02-13T01:19:38.743 INFO:teuthology.orchestra.run.trial040.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 1.9 MB/s | 166 kB 00:00 2026-02-13T01:19:39.096 INFO:teuthology.orchestra.run.trial040.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 11 MB/s | 5.0 MB 00:00 2026-02-13T01:19:39.330 INFO:teuthology.orchestra.run.trial055.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 4.8 MB/s | 24 MB 00:05 2026-02-13T01:19:39.353 INFO:teuthology.orchestra.run.trial118.stdout:(48/173): libquadmath-11.5.0-14.el9.x86_64.rpm 250 kB/s | 184 kB 00:00 2026-02-13T01:19:39.369 INFO:teuthology.orchestra.run.trial118.stdout:(49/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 143 kB/s | 94 kB 00:00 2026-02-13T01:19:39.400 INFO:teuthology.orchestra.run.trial118.stdout:(50/173): libgfortran-11.5.0-14.el9.x86_64.rpm 880 kB/s | 794 kB 00:00 2026-02-13T01:19:39.527 INFO:teuthology.orchestra.run.trial055.stdout:(10/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 10 MB/s | 19 MB 00:01 2026-02-13T01:19:39.548 INFO:teuthology.orchestra.run.trial055.stdout:(11/173): ceph-osd-classic-20.3.0-5241.g8f8d382 6.3 MB/s | 16 MB 00:02 2026-02-13T01:19:39.549 INFO:teuthology.orchestra.run.trial055.stdout:(12/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 1.1 MB/s | 25 kB 00:00 2026-02-13T01:19:39.583 INFO:teuthology.orchestra.run.trial055.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 6.8 MB/s | 243 kB 00:00 2026-02-13T01:19:39.598 INFO:teuthology.orchestra.run.trial055.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 1.8 MB/s | 27 kB 00:00 2026-02-13T01:19:39.615 INFO:teuthology.orchestra.run.trial055.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 2.2 MB/s | 37 kB 00:00 2026-02-13T01:19:39.630 INFO:teuthology.orchestra.run.trial055.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 1.6 MB/s | 24 kB 00:00 2026-02-13T01:19:39.721 INFO:teuthology.orchestra.run.trial055.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 9.8 MB/s | 909 kB 00:00 2026-02-13T01:19:39.739 INFO:teuthology.orchestra.run.trial055.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 8.5 MB/s | 159 kB 00:00 2026-02-13T01:19:39.757 INFO:teuthology.orchestra.run.trial055.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 6.8 MB/s | 123 kB 00:00 2026-02-13T01:19:39.793 INFO:teuthology.orchestra.run.trial055.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 6.8 MB/s | 248 kB 00:00 2026-02-13T01:19:39.914 INFO:teuthology.orchestra.run.trial118.stdout:(51/173): mailcap-2.1.49-5.el9.noarch.rpm 59 kB/s | 33 kB 00:00 2026-02-13T01:19:40.024 INFO:teuthology.orchestra.run.trial118.stdout:(52/173): pciutils-3.7.0-7.el9.x86_64.rpm 142 kB/s | 93 kB 00:00 2026-02-13T01:19:40.174 INFO:teuthology.orchestra.run.trial118.stdout:(53/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 327 kB/s | 253 kB 00:00 2026-02-13T01:19:40.413 INFO:teuthology.orchestra.run.trial040.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 10 MB/s | 24 MB 00:02 2026-02-13T01:19:40.424 INFO:teuthology.orchestra.run.trial055.stdout:(21/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 10 MB/s | 6.5 MB 00:00 2026-02-13T01:19:40.436 INFO:teuthology.orchestra.run.trial055.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 3.5 MB/s | 45 kB 00:00 2026-02-13T01:19:40.446 INFO:teuthology.orchestra.run.trial055.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 15 MB/s | 185 kB 00:00 2026-02-13T01:19:40.449 INFO:teuthology.orchestra.run.trial040.stdout:(10/173): ceph-osd-classic-20.3.0-5241.g8f8d382 9.2 MB/s | 16 MB 00:01 2026-02-13T01:19:40.462 INFO:teuthology.orchestra.run.trial040.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 1.8 MB/s | 25 kB 00:00 2026-02-13T01:19:40.469 INFO:teuthology.orchestra.run.trial055.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 9.0 MB/s | 204 kB 00:00 2026-02-13T01:19:40.512 INFO:teuthology.orchestra.run.trial055.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 7.4 MB/s | 324 kB 00:00 2026-02-13T01:19:40.554 INFO:teuthology.orchestra.run.trial055.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 7.2 MB/s | 306 kB 00:00 2026-02-13T01:19:40.574 INFO:teuthology.orchestra.run.trial055.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 4.8 MB/s | 100 kB 00:00 2026-02-13T01:19:40.594 INFO:teuthology.orchestra.run.trial055.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 4.1 MB/s | 84 kB 00:00 2026-02-13T01:19:40.642 INFO:teuthology.orchestra.run.trial055.stdout:(29/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 10 MB/s | 13 MB 00:01 2026-02-13T01:19:40.664 INFO:teuthology.orchestra.run.trial055.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 7.7 MB/s | 172 kB 00:00 2026-02-13T01:19:40.684 INFO:teuthology.orchestra.run.trial055.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 2.8 MB/s | 57 kB 00:00 2026-02-13T01:19:40.696 INFO:teuthology.orchestra.run.trial118.stdout:(54/173): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2026-02-13T01:19:40.706 INFO:teuthology.orchestra.run.trial055.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 8.0 MB/s | 183 kB 00:00 2026-02-13T01:19:40.832 INFO:teuthology.orchestra.run.trial040.stdout:(12/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 11 MB/s | 19 MB 00:01 2026-02-13T01:19:40.863 INFO:teuthology.orchestra.run.trial118.stdout:(55/173): python3-cryptography-36.0.1-5.el9.x86 1.3 MB/s | 1.2 MB 00:00 2026-02-13T01:19:40.864 INFO:teuthology.orchestra.run.trial055.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 11 MB/s | 2.9 MB 00:00 2026-02-13T01:19:40.870 INFO:teuthology.orchestra.run.trial040.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 6.1 MB/s | 243 kB 00:00 2026-02-13T01:19:40.878 INFO:teuthology.orchestra.run.trial118.stdout:(56/173): python3-pycparser-2.20-6.el9.noarch.r 192 kB/s | 135 kB 00:00 2026-02-13T01:19:40.893 INFO:teuthology.orchestra.run.trial040.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 1.2 MB/s | 27 kB 00:00 2026-02-13T01:19:40.913 INFO:teuthology.orchestra.run.trial040.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 1.8 MB/s | 37 kB 00:00 2026-02-13T01:19:40.934 INFO:teuthology.orchestra.run.trial040.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 1.2 MB/s | 24 kB 00:00 2026-02-13T01:19:41.027 INFO:teuthology.orchestra.run.trial040.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 9.6 MB/s | 909 kB 00:00 2026-02-13T01:19:41.050 INFO:teuthology.orchestra.run.trial040.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 6.9 MB/s | 159 kB 00:00 2026-02-13T01:19:41.072 INFO:teuthology.orchestra.run.trial040.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 5.4 MB/s | 123 kB 00:00 2026-02-13T01:19:41.116 INFO:teuthology.orchestra.run.trial040.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 5.6 MB/s | 248 kB 00:00 2026-02-13T01:19:41.392 INFO:teuthology.orchestra.run.trial118.stdout:(57/173): python3-requests-2.25.1-10.el9.noarch 182 kB/s | 126 kB 00:00 2026-02-13T01:19:41.596 INFO:teuthology.orchestra.run.trial055.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 10 MB/s | 7.4 MB 00:00 2026-02-13T01:19:41.607 INFO:teuthology.orchestra.run.trial118.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 250 kB/s | 182 kB 00:00 2026-02-13T01:19:41.614 INFO:teuthology.orchestra.run.trial118.stdout:(59/173): python3-urllib3-1.26.5-7.el9.noarch.r 290 kB/s | 218 kB 00:00 2026-02-13T01:19:41.635 INFO:teuthology.orchestra.run.trial118.stdout:(60/173): automake-1.16.2-8.el9.noarch.rpm 24 MB/s | 689 kB 00:00 2026-02-13T01:19:41.641 INFO:teuthology.orchestra.run.trial118.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 19 MB/s | 104 kB 00:00 2026-02-13T01:19:41.642 INFO:teuthology.orchestra.run.trial055.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 6.2 MB/s | 297 kB 00:00 2026-02-13T01:19:41.645 INFO:teuthology.orchestra.run.trial118.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 17 MB/s | 79 kB 00:00 2026-02-13T01:19:41.652 INFO:teuthology.orchestra.run.trial118.stdout:(63/173): bison-3.7.4-5.el9.x86_64.rpm 25 MB/s | 943 kB 00:00 2026-02-13T01:19:41.653 INFO:teuthology.orchestra.run.trial118.stdout:(64/173): flex-2.6.4-9.el9.x86_64.rpm 40 MB/s | 313 kB 00:00 2026-02-13T01:19:41.657 INFO:teuthology.orchestra.run.trial118.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 7.4 MB/s | 33 kB 00:00 2026-02-13T01:19:41.661 INFO:teuthology.orchestra.run.trial118.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 4.4 MB/s | 18 kB 00:00 2026-02-13T01:19:41.665 INFO:teuthology.orchestra.run.trial055.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 2.2 MB/s | 50 kB 00:00 2026-02-13T01:19:41.665 INFO:teuthology.orchestra.run.trial118.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 2.6 MB/s | 11 kB 00:00 2026-02-13T01:19:41.670 INFO:teuthology.orchestra.run.trial118.stdout:(68/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 176 MB/s | 3.0 MB 00:00 2026-02-13T01:19:41.674 INFO:teuthology.orchestra.run.trial118.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-13T01:19:41.677 INFO:teuthology.orchestra.run.trial118.stdout:(70/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 24 MB/s | 160 kB 00:00 2026-02-13T01:19:41.678 INFO:teuthology.orchestra.run.trial118.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 9.8 MB/s | 45 kB 00:00 2026-02-13T01:19:41.683 INFO:teuthology.orchestra.run.trial055.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 954 kB/s | 17 kB 00:00 2026-02-13T01:19:41.684 INFO:teuthology.orchestra.run.trial118.stdout:(72/173): librdkafka-1.6.1-102.el9.x86_64.rpm 86 MB/s | 662 kB 00:00 2026-02-13T01:19:41.687 INFO:teuthology.orchestra.run.trial118.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 28 MB/s | 246 kB 00:00 2026-02-13T01:19:41.692 INFO:teuthology.orchestra.run.trial118.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 78 MB/s | 581 kB 00:00 2026-02-13T01:19:41.692 INFO:teuthology.orchestra.run.trial118.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 4.8 MB/s | 25 kB 00:00 2026-02-13T01:19:41.697 INFO:teuthology.orchestra.run.trial118.stdout:(76/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 11 MB/s | 51 kB 00:00 2026-02-13T01:19:41.698 INFO:teuthology.orchestra.run.trial040.stdout:(21/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 10 MB/s | 13 MB 00:01 2026-02-13T01:19:41.699 INFO:teuthology.orchestra.run.trial118.stdout:(77/173): libxslt-1.1.34-12.el9.x86_64.rpm 35 MB/s | 233 kB 00:00 2026-02-13T01:19:41.705 INFO:teuthology.orchestra.run.trial118.stdout:(78/173): lua-5.4.4-4.el9.x86_64.rpm 30 MB/s | 188 kB 00:00 2026-02-13T01:19:41.706 INFO:teuthology.orchestra.run.trial118.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 33 MB/s | 292 kB 00:00 2026-02-13T01:19:41.707 INFO:teuthology.orchestra.run.trial055.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 12 MB/s | 299 kB 00:00 2026-02-13T01:19:41.710 INFO:teuthology.orchestra.run.trial118.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 9.3 MB/s | 42 kB 00:00 2026-02-13T01:19:41.719 INFO:teuthology.orchestra.run.trial040.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 2.1 MB/s | 45 kB 00:00 2026-02-13T01:19:41.749 INFO:teuthology.orchestra.run.trial040.stdout:(23/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 10 MB/s | 6.5 MB 00:00 2026-02-13T01:19:41.750 INFO:teuthology.orchestra.run.trial040.stdout:(24/173): python3-ceph-common-20.3.0-5241.g8f8d 5.8 MB/s | 185 kB 00:00 2026-02-13T01:19:41.769 INFO:teuthology.orchestra.run.trial040.stdout:(25/173): python3-cephfs-20.3.0-5241.g8f8d3829. 9.9 MB/s | 204 kB 00:00 2026-02-13T01:19:41.776 INFO:teuthology.orchestra.run.trial118.stdout:(81/173): openblas-openmp-0.3.29-1.el9.x86_64.r 75 MB/s | 5.3 MB 00:00 2026-02-13T01:19:41.780 INFO:teuthology.orchestra.run.trial118.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 5.0 MB/s | 22 kB 00:00 2026-02-13T01:19:41.785 INFO:teuthology.orchestra.run.trial118.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 12 MB/s | 58 kB 00:00 2026-02-13T01:19:41.789 INFO:teuthology.orchestra.run.trial118.stdout:(84/173): perl-threads-shared-1.61-460.el9.x86_ 10 MB/s | 45 kB 00:00 2026-02-13T01:19:41.799 INFO:teuthology.orchestra.run.trial040.stdout:(26/173): python3-rados-20.3.0-5241.g8f8d3829.e 6.5 MB/s | 324 kB 00:00 2026-02-13T01:19:41.805 INFO:teuthology.orchestra.run.trial118.stdout:(85/173): postgresql-13.23-1.el9.x86_64.rpm 105 MB/s | 1.6 MB 00:00 2026-02-13T01:19:41.811 INFO:teuthology.orchestra.run.trial118.stdout:(86/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 47 MB/s | 4.8 MB 00:00 2026-02-13T01:19:41.812 INFO:teuthology.orchestra.run.trial040.stdout:(27/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 7.0 MB/s | 306 kB 00:00 2026-02-13T01:19:41.813 INFO:teuthology.orchestra.run.trial055.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 9.6 MB/s | 1.0 MB 00:00 2026-02-13T01:19:41.817 INFO:teuthology.orchestra.run.trial040.stdout:(28/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 5.6 MB/s | 100 kB 00:00 2026-02-13T01:19:41.833 INFO:teuthology.orchestra.run.trial055.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 909 kB/s | 18 kB 00:00 2026-02-13T01:19:41.834 INFO:teuthology.orchestra.run.trial040.stdout:(29/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 3.9 MB/s | 84 kB 00:00 2026-02-13T01:19:41.854 INFO:teuthology.orchestra.run.trial040.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 8.3 MB/s | 172 kB 00:00 2026-02-13T01:19:41.872 INFO:teuthology.orchestra.run.trial118.stdout:(87/173): postgresql-private-libs-13.23-1.el9.x 2.2 MB/s | 138 kB 00:00 2026-02-13T01:19:41.872 INFO:teuthology.orchestra.run.trial040.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 3.1 MB/s | 57 kB 00:00 2026-02-13T01:19:41.876 INFO:teuthology.orchestra.run.trial118.stdout:(88/173): postgresql-contrib-13.23-1.el9.x86_64 12 MB/s | 903 kB 00:00 2026-02-13T01:19:41.902 INFO:teuthology.orchestra.run.trial118.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 39 MB/s | 1.0 MB 00:00 2026-02-13T01:19:41.912 INFO:teuthology.orchestra.run.trial118.stdout:(90/173): postgresql-server-13.23-1.el9.x86_64. 143 MB/s | 5.8 MB 00:00 2026-02-13T01:19:41.927 INFO:teuthology.orchestra.run.trial040.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 3.3 MB/s | 183 kB 00:00 2026-02-13T01:19:41.928 INFO:teuthology.orchestra.run.trial118.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 3.9 MB/s | 61 kB 00:00 2026-02-13T01:19:41.934 INFO:teuthology.orchestra.run.trial118.stdout:(92/173): python3-devel-3.9.25-2.el9.x86_64.rpm 35 MB/s | 244 kB 00:00 2026-02-13T01:19:41.941 INFO:teuthology.orchestra.run.trial118.stdout:(93/173): python3-jinja2-2.11.3-8.el9.noarch.rp 35 MB/s | 249 kB 00:00 2026-02-13T01:19:41.946 INFO:teuthology.orchestra.run.trial118.stdout:(94/173): python3-jmespath-1.0.1-1.el9.noarch.r 9.8 MB/s | 48 kB 00:00 2026-02-13T01:19:41.952 INFO:teuthology.orchestra.run.trial118.stdout:(95/173): python3-libstoragemgmt-1.10.1-1.el9.x 30 MB/s | 177 kB 00:00 2026-02-13T01:19:41.957 INFO:teuthology.orchestra.run.trial118.stdout:(96/173): python3-markupsafe-1.1.1-12.el9.x86_6 7.2 MB/s | 35 kB 00:00 2026-02-13T01:19:41.967 INFO:teuthology.orchestra.run.trial118.stdout:(97/173): python3-babel-2.9.1-2.el9.noarch.rpm 91 MB/s | 6.0 MB 00:00 2026-02-13T01:19:41.978 INFO:teuthology.orchestra.run.trial118.stdout:(98/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 39 MB/s | 442 kB 00:00 2026-02-13T01:19:41.987 INFO:teuthology.orchestra.run.trial118.stdout:(99/173): python3-numpy-1.23.5-2.el9.x86_64.rpm 202 MB/s | 6.1 MB 00:00 2026-02-13T01:19:41.988 INFO:teuthology.orchestra.run.trial118.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 8.1 MB/s | 77 kB 00:00 2026-02-13T01:19:41.994 INFO:teuthology.orchestra.run.trial118.stdout:(101/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 28 MB/s | 159 kB 00:00 2026-02-13T01:19:41.995 INFO:teuthology.orchestra.run.trial118.stdout:(102/173): python3-protobuf-3.14.0-17.el9.noarc 36 MB/s | 267 kB 00:00 2026-02-13T01:19:42.000 INFO:teuthology.orchestra.run.trial118.stdout:(103/173): python3-requests-oauthlib-1.3.0-12.e 9.7 MB/s | 54 kB 00:00 2026-02-13T01:19:42.001 INFO:teuthology.orchestra.run.trial118.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 36 MB/s | 279 kB 00:00 2026-02-13T01:19:42.007 INFO:teuthology.orchestra.run.trial118.stdout:(105/173): python3-toml-0.10.2-6.el9.noarch.rpm 6.9 MB/s | 42 kB 00:00 2026-02-13T01:19:42.013 INFO:teuthology.orchestra.run.trial118.stdout:(106/173): python3-wcwidth-0.2.5-8.el9.noarch.r 8.1 MB/s | 44 kB 00:00 2026-02-13T01:19:42.018 INFO:teuthology.orchestra.run.trial118.stdout:(107/173): qatlib-25.08.0-2.el9.x86_64.rpm 45 MB/s | 240 kB 00:00 2026-02-13T01:19:42.023 INFO:teuthology.orchestra.run.trial118.stdout:(108/173): qatlib-service-25.08.0-2.el9.x86_64. 7.8 MB/s | 37 kB 00:00 2026-02-13T01:19:42.027 INFO:teuthology.orchestra.run.trial118.stdout:(109/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 14 MB/s | 66 kB 00:00 2026-02-13T01:19:42.032 INFO:teuthology.orchestra.run.trial118.stdout:(110/173): socat-1.7.4.1-8.el9.x86_64.rpm 58 MB/s | 303 kB 00:00 2026-02-13T01:19:42.046 INFO:teuthology.orchestra.run.trial040.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 13 MB/s | 2.9 MB 00:00 2026-02-13T01:19:42.053 INFO:teuthology.orchestra.run.trial118.stdout:(111/173): uuid-1.6.2-55.el9.x86_64.rpm 2.8 MB/s | 58 kB 00:00 2026-02-13T01:19:42.058 INFO:teuthology.orchestra.run.trial118.stdout:(112/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 17 MB/s | 96 kB 00:00 2026-02-13T01:19:42.063 INFO:teuthology.orchestra.run.trial118.stdout:(113/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-13T01:19:42.068 INFO:teuthology.orchestra.run.trial055.stdout:(41/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 11 MB/s | 15 MB 00:01 2026-02-13T01:19:42.068 INFO:teuthology.orchestra.run.trial118.stdout:(114/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 10 MB/s | 45 kB 00:00 2026-02-13T01:19:42.094 INFO:teuthology.orchestra.run.trial118.stdout:(115/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 207 MB/s | 19 MB 00:00 2026-02-13T01:19:42.163 INFO:teuthology.orchestra.run.trial118.stdout:(116/173): zip-3.0-35.el9.x86_64.rpm 344 kB/s | 266 kB 00:00 2026-02-13T01:19:42.165 INFO:teuthology.orchestra.run.trial055.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 1.0 MB/s | 350 kB 00:00 2026-02-13T01:19:42.396 INFO:teuthology.orchestra.run.trial055.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 176 kB/s | 40 kB 00:00 2026-02-13T01:19:42.520 INFO:teuthology.orchestra.run.trial040.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 16 MB/s | 7.4 MB 00:00 2026-02-13T01:19:42.529 INFO:teuthology.orchestra.run.trial118.stdout:(117/173): lua-devel-5.4.4-4.el9.x86_64.rpm 48 kB/s | 22 kB 00:00 2026-02-13T01:19:42.535 INFO:teuthology.orchestra.run.trial118.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.4 MB/s | 551 kB 00:00 2026-02-13T01:19:42.552 INFO:teuthology.orchestra.run.trial040.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 9.1 MB/s | 297 kB 00:00 2026-02-13T01:19:42.568 INFO:teuthology.orchestra.run.trial040.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 3.2 MB/s | 50 kB 00:00 2026-02-13T01:19:42.577 INFO:teuthology.orchestra.run.trial055.stdout:(44/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 4.1 MB/s | 2.1 MB 00:00 2026-02-13T01:19:42.578 INFO:teuthology.orchestra.run.trial118.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 450 kB/s | 19 kB 00:00 2026-02-13T01:19:42.581 INFO:teuthology.orchestra.run.trial055.stdout:(45/173): libatomic-11.5.0-14.el9.x86_64.rpm 123 kB/s | 23 kB 00:00 2026-02-13T01:19:42.583 INFO:teuthology.orchestra.run.trial040.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 1.2 MB/s | 17 kB 00:00 2026-02-13T01:19:42.617 INFO:teuthology.orchestra.run.trial040.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 8.6 MB/s | 299 kB 00:00 2026-02-13T01:19:42.695 INFO:teuthology.orchestra.run.trial040.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 13 MB/s | 1.0 MB 00:00 2026-02-13T01:19:42.711 INFO:teuthology.orchestra.run.trial040.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 1.1 MB/s | 18 kB 00:00 2026-02-13T01:19:42.770 INFO:teuthology.orchestra.run.trial118.stdout:(120/173): libarrow-9.0.0-15.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2026-02-13T01:19:42.811 INFO:teuthology.orchestra.run.trial055.stdout:(46/173): libconfig-1.7.2-9.el9.x86_64.rpm 309 kB/s | 72 kB 00:00 2026-02-13T01:19:42.812 INFO:teuthology.orchestra.run.trial118.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 580 kB/s | 25 kB 00:00 2026-02-13T01:19:42.817 INFO:teuthology.orchestra.run.trial040.stdout:(41/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.2 MB/s | 350 kB 00:00 2026-02-13T01:19:42.853 INFO:teuthology.orchestra.run.trial118.stdout:(122/173): gperftools-libs-2.9.1-3.el9.x86_64.r 951 kB/s | 308 kB 00:00 2026-02-13T01:19:42.856 INFO:teuthology.orchestra.run.trial118.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2026-02-13T01:19:42.889 INFO:teuthology.orchestra.run.trial040.stdout:(42/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 29 MB/s | 2.1 MB 00:00 2026-02-13T01:19:42.900 INFO:teuthology.orchestra.run.trial118.stdout:(124/173): luarocks-3.9.2-5.el9.noarch.rpm 3.4 MB/s | 151 kB 00:00 2026-02-13T01:19:42.901 INFO:teuthology.orchestra.run.trial118.stdout:(125/173): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2026-02-13T01:19:42.912 INFO:teuthology.orchestra.run.trial040.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.8 MB/s | 40 kB 00:00 2026-02-13T01:19:42.933 INFO:teuthology.orchestra.run.trial040.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 23 kB 00:00 2026-02-13T01:19:42.949 INFO:teuthology.orchestra.run.trial118.stdout:(126/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 17 MB/s | 838 kB 00:00 2026-02-13T01:19:42.956 INFO:teuthology.orchestra.run.trial040.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 3.1 MB/s | 72 kB 00:00 2026-02-13T01:19:42.984 INFO:teuthology.orchestra.run.trial040.stdout:(46/173): libgfortran-11.5.0-14.el9.x86_64.rpm 29 MB/s | 794 kB 00:00 2026-02-13T01:19:42.991 INFO:teuthology.orchestra.run.trial118.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 690 kB/s | 29 kB 00:00 2026-02-13T01:19:42.995 INFO:teuthology.orchestra.run.trial055.stdout:(47/173): libgfortran-11.5.0-14.el9.x86_64.rpm 1.9 MB/s | 794 kB 00:00 2026-02-13T01:19:43.004 INFO:teuthology.orchestra.run.trial118.stdout:(128/173): python3-asyncssh-2.13.2-5.el9.noarch 5.2 MB/s | 548 kB 00:00 2026-02-13T01:19:43.007 INFO:teuthology.orchestra.run.trial040.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 7.6 MB/s | 184 kB 00:00 2026-02-13T01:19:43.030 INFO:teuthology.orchestra.run.trial040.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 4.0 MB/s | 94 kB 00:00 2026-02-13T01:19:43.035 INFO:teuthology.orchestra.run.trial118.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 1.3 MB/s | 60 kB 00:00 2026-02-13T01:19:43.048 INFO:teuthology.orchestra.run.trial118.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 994 kB/s | 43 kB 00:00 2026-02-13T01:19:43.052 INFO:teuthology.orchestra.run.trial040.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 1.5 MB/s | 33 kB 00:00 2026-02-13T01:19:43.074 INFO:teuthology.orchestra.run.trial040.stdout:(50/173): pciutils-3.7.0-7.el9.x86_64.rpm 4.2 MB/s | 93 kB 00:00 2026-02-13T01:19:43.078 INFO:teuthology.orchestra.run.trial118.stdout:(131/173): python3-cachetools-4.2.4-1.el9.noarc 754 kB/s | 32 kB 00:00 2026-02-13T01:19:43.090 INFO:teuthology.orchestra.run.trial118.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 333 kB/s | 14 kB 00:00 2026-02-13T01:19:43.100 INFO:teuthology.orchestra.run.trial055.stdout:(48/173): libquadmath-11.5.0-14.el9.x86_64.rpm 637 kB/s | 184 kB 00:00 2026-02-13T01:19:43.104 INFO:teuthology.orchestra.run.trial040.stdout:(51/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 13 MB/s | 15 MB 00:01 2026-02-13T01:19:43.107 INFO:teuthology.orchestra.run.trial040.stdout:(52/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 7.7 MB/s | 253 kB 00:00 2026-02-13T01:19:43.123 INFO:teuthology.orchestra.run.trial118.stdout:(133/173): python3-cheroot-10.0.1-4.el9.noarch. 3.8 MB/s | 173 kB 00:00 2026-02-13T01:19:43.131 INFO:teuthology.orchestra.run.trial040.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-13T01:19:43.146 INFO:teuthology.orchestra.run.trial118.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 6.4 MB/s | 358 kB 00:00 2026-02-13T01:19:43.154 INFO:teuthology.orchestra.run.trial040.stdout:(54/173): python3-pycparser-2.20-6.el9.noarch.r 5.8 MB/s | 135 kB 00:00 2026-02-13T01:19:43.169 INFO:teuthology.orchestra.run.trial118.stdout:(135/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.5 MB/s | 303 kB 00:00 2026-02-13T01:19:43.178 INFO:teuthology.orchestra.run.trial040.stdout:(55/173): python3-requests-2.25.1-10.el9.noarch 5.1 MB/s | 126 kB 00:00 2026-02-13T01:19:43.197 INFO:teuthology.orchestra.run.trial118.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 4.9 MB/s | 254 kB 00:00 2026-02-13T01:19:43.203 INFO:teuthology.orchestra.run.trial040.stdout:(56/173): python3-urllib3-1.26.5-7.el9.noarch.r 8.5 MB/s | 218 kB 00:00 2026-02-13T01:19:43.227 INFO:teuthology.orchestra.run.trial118.stdout:(137/173): python3-grpcio-1.46.7-10.el9.x86_64. 35 MB/s | 2.0 MB 00:00 2026-02-13T01:19:43.228 INFO:teuthology.orchestra.run.trial040.stdout:(57/173): unzip-6.0-59.el9.x86_64.rpm 7.1 MB/s | 182 kB 00:00 2026-02-13T01:19:43.244 INFO:teuthology.orchestra.run.trial118.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 3.0 MB/s | 144 kB 00:00 2026-02-13T01:19:43.254 INFO:teuthology.orchestra.run.trial040.stdout:(58/173): python3-cryptography-36.0.1-5.el9.x86 8.3 MB/s | 1.2 MB 00:00 2026-02-13T01:19:43.256 INFO:teuthology.orchestra.run.trial040.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 9.5 MB/s | 266 kB 00:00 2026-02-13T01:19:43.269 INFO:teuthology.orchestra.run.trial118.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 250 kB/s | 11 kB 00:00 2026-02-13T01:19:43.270 INFO:teuthology.orchestra.run.trial055.stdout:(49/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 342 kB/s | 94 kB 00:00 2026-02-13T01:19:43.287 INFO:teuthology.orchestra.run.trial118.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 413 kB/s | 18 kB 00:00 2026-02-13T01:19:43.289 INFO:teuthology.orchestra.run.trial055.stdout:(50/173): mailcap-2.1.49-5.el9.noarch.rpm 175 kB/s | 33 kB 00:00 2026-02-13T01:19:43.312 INFO:teuthology.orchestra.run.trial118.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 541 kB/s | 23 kB 00:00 2026-02-13T01:19:43.330 INFO:teuthology.orchestra.run.trial118.stdout:(142/173): python3-jaraco-context-6.0.1-3.el9.n 457 kB/s | 20 kB 00:00 2026-02-13T01:19:43.355 INFO:teuthology.orchestra.run.trial118.stdout:(143/173): python3-jaraco-functools-3.5.0-2.el9 455 kB/s | 19 kB 00:00 2026-02-13T01:19:43.374 INFO:teuthology.orchestra.run.trial118.stdout:(144/173): python3-jaraco-text-4.0.0-2.el9.noar 610 kB/s | 26 kB 00:00 2026-02-13T01:19:43.405 INFO:teuthology.orchestra.run.trial118.stdout:(145/173): python3-kubernetes-26.1.0-3.el9.noar 20 MB/s | 1.0 MB 00:00 2026-02-13T01:19:43.418 INFO:teuthology.orchestra.run.trial118.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 1.7 MB/s | 79 kB 00:00 2026-02-13T01:19:43.448 INFO:teuthology.orchestra.run.trial118.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2026-02-13T01:19:43.461 INFO:teuthology.orchestra.run.trial118.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 385 kB/s | 16 kB 00:00 2026-02-13T01:19:43.480 INFO:teuthology.orchestra.run.trial118.stdout:(149/173): protobuf-compiler-3.14.0-17.el9.x86_ 622 kB/s | 862 kB 00:01 2026-02-13T01:19:43.492 INFO:teuthology.orchestra.run.trial118.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.0 MB/s | 90 kB 00:00 2026-02-13T01:19:43.504 INFO:teuthology.orchestra.run.trial118.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 653 kB/s | 28 kB 00:00 2026-02-13T01:19:43.536 INFO:teuthology.orchestra.run.trial118.stdout:(152/173): python3-routes-2.5.1-5.el9.noarch.rp 4.2 MB/s | 188 kB 00:00 2026-02-13T01:19:43.545 INFO:teuthology.orchestra.run.trial055.stdout:(51/173): pciutils-3.7.0-7.el9.x86_64.rpm 339 kB/s | 93 kB 00:00 2026-02-13T01:19:43.548 INFO:teuthology.orchestra.run.trial118.stdout:(153/173): python3-rsa-4.9-2.el9.noarch.rpm 1.3 MB/s | 59 kB 00:00 2026-02-13T01:19:43.579 INFO:teuthology.orchestra.run.trial118.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 834 kB/s | 36 kB 00:00 2026-02-13T01:19:43.594 INFO:teuthology.orchestra.run.trial118.stdout:(155/173): python3-typing-extensions-4.15.0-1.e 1.9 MB/s | 86 kB 00:00 2026-02-13T01:19:43.610 INFO:teuthology.orchestra.run.trial055.stdout:(52/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 788 kB/s | 253 kB 00:00 2026-02-13T01:19:43.622 INFO:teuthology.orchestra.run.trial118.stdout:(156/173): python3-websocket-client-1.2.3-2.el9 2.0 MB/s | 90 kB 00:00 2026-02-13T01:19:43.637 INFO:teuthology.orchestra.run.trial118.stdout:(157/173): python3-xmltodict-0.12.0-15.el9.noar 518 kB/s | 22 kB 00:00 2026-02-13T01:19:43.665 INFO:teuthology.orchestra.run.trial118.stdout:(158/173): python3-zc-lockfile-2.0-10.el9.noarc 467 kB/s | 20 kB 00:00 2026-02-13T01:19:43.668 INFO:teuthology.orchestra.run.trial118.stdout:(159/173): python3-repoze-lru-0.7-16.el9.noarch 163 kB/s | 31 kB 00:00 2026-02-13T01:19:43.685 INFO:teuthology.orchestra.run.trial118.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2026-02-13T01:19:43.719 INFO:teuthology.orchestra.run.trial118.stdout:(161/173): thrift-0.15.0-4.el9.x86_64.rpm 29 MB/s | 1.6 MB 00:00 2026-02-13T01:19:43.805 INFO:teuthology.orchestra.run.trial118.stdout:(162/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 890 kB/s | 122 kB 00:00 2026-02-13T01:19:43.891 INFO:teuthology.orchestra.run.trial055.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 379 kB/s | 106 kB 00:00 2026-02-13T01:19:43.964 INFO:teuthology.orchestra.run.trial118.stdout:(163/173): librados2-20.3.0-5241.g8f8d3829.el9. 13 MB/s | 3.5 MB 00:00 2026-02-13T01:19:44.000 INFO:teuthology.orchestra.run.trial118.stdout:(164/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 10 MB/s | 2.8 MB 00:00 2026-02-13T01:19:44.103 INFO:teuthology.orchestra.run.trial055.stdout:(54/173): python3-cryptography-36.0.1-5.el9.x86 2.2 MB/s | 1.2 MB 00:00 2026-02-13T01:19:44.159 INFO:teuthology.orchestra.run.trial040.stdout:(60/173): automake-1.16.2-8.el9.noarch.rpm 761 kB/s | 689 kB 00:00 2026-02-13T01:19:44.170 INFO:teuthology.orchestra.run.trial055.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 486 kB/s | 135 kB 00:00 2026-02-13T01:19:44.265 INFO:teuthology.orchestra.run.trial040.stdout:(61/173): bison-3.7.4-5.el9.x86_64.rpm 934 kB/s | 943 kB 00:01 2026-02-13T01:19:44.380 INFO:teuthology.orchestra.run.trial055.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 457 kB/s | 126 kB 00:00 2026-02-13T01:19:44.498 INFO:teuthology.orchestra.run.trial055.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 665 kB/s | 218 kB 00:00 2026-02-13T01:19:44.570 INFO:teuthology.orchestra.run.trial118.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 65 kB/s | 37 kB 00:00 2026-02-13T01:19:44.662 INFO:teuthology.orchestra.run.trial055.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 645 kB/s | 182 kB 00:00 2026-02-13T01:19:44.821 INFO:teuthology.orchestra.run.trial055.stdout:(59/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 15 MB/s | 78 MB 00:05 2026-02-13T01:19:44.834 INFO:teuthology.orchestra.run.trial040.stdout:(62/173): boost-program-options-1.75.0-13.el9.x 154 kB/s | 104 kB 00:00 2026-02-13T01:19:44.836 INFO:teuthology.orchestra.run.trial055.stdout:(60/173): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 689 kB 00:00 2026-02-13T01:19:44.846 INFO:teuthology.orchestra.run.trial055.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 10 MB/s | 104 kB 00:00 2026-02-13T01:19:44.857 INFO:teuthology.orchestra.run.trial055.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 7.3 MB/s | 79 kB 00:00 2026-02-13T01:19:44.870 INFO:teuthology.orchestra.run.trial055.stdout:(63/173): flex-2.6.4-9.el9.x86_64.rpm 23 MB/s | 313 kB 00:00 2026-02-13T01:19:44.880 INFO:teuthology.orchestra.run.trial055.stdout:(64/173): flexiblas-3.0.4-8.el9.x86_64.rpm 3.2 MB/s | 33 kB 00:00 2026-02-13T01:19:44.884 INFO:teuthology.orchestra.run.trial055.stdout:(65/173): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 943 kB 00:00 2026-02-13T01:19:44.904 INFO:teuthology.orchestra.run.trial055.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 880 kB/s | 18 kB 00:00 2026-02-13T01:19:44.913 INFO:teuthology.orchestra.run.trial055.stdout:(67/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 91 MB/s | 3.0 MB 00:00 2026-02-13T01:19:44.913 INFO:teuthology.orchestra.run.trial055.stdout:(68/173): libaio-devel-0.3.111-13.el9.x86_64.rp 1.2 MB/s | 11 kB 00:00 2026-02-13T01:19:44.915 INFO:teuthology.orchestra.run.trial055.stdout:(69/173): zip-3.0-35.el9.x86_64.rpm 637 kB/s | 266 kB 00:00 2026-02-13T01:19:44.923 INFO:teuthology.orchestra.run.trial055.stdout:(70/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 16 MB/s | 160 kB 00:00 2026-02-13T01:19:44.925 INFO:teuthology.orchestra.run.trial055.stdout:(71/173): libnbd-1.20.3-4.el9.x86_64.rpm 14 MB/s | 164 kB 00:00 2026-02-13T01:19:44.945 INFO:teuthology.orchestra.run.trial055.stdout:(72/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.5 MB/s | 45 kB 00:00 2026-02-13T01:19:44.954 INFO:teuthology.orchestra.run.trial055.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 8.3 MB/s | 246 kB 00:00 2026-02-13T01:19:44.963 INFO:teuthology.orchestra.run.trial055.stdout:(74/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 2.5 MB/s | 25 kB 00:00 2026-02-13T01:19:44.976 INFO:teuthology.orchestra.run.trial055.stdout:(75/173): libxslt-1.1.34-12.el9.x86_64.rpm 17 MB/s | 233 kB 00:00 2026-02-13T01:19:44.980 INFO:teuthology.orchestra.run.trial055.stdout:(76/173): libtool-2.4.6-46.el9.x86_64.rpm 16 MB/s | 581 kB 00:00 2026-02-13T01:19:44.982 INFO:teuthology.orchestra.run.trial055.stdout:(77/173): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2026-02-13T01:19:44.987 INFO:teuthology.orchestra.run.trial055.stdout:(78/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 4.8 MB/s | 51 kB 00:00 2026-02-13T01:19:44.992 INFO:teuthology.orchestra.run.trial055.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 26 MB/s | 292 kB 00:00 2026-02-13T01:19:44.995 INFO:teuthology.orchestra.run.trial055.stdout:(80/173): lua-5.4.4-4.el9.x86_64.rpm 15 MB/s | 188 kB 00:00 2026-02-13T01:19:44.997 INFO:teuthology.orchestra.run.trial055.stdout:(81/173): openblas-0.3.29-1.el9.x86_64.rpm 4.2 MB/s | 42 kB 00:00 2026-02-13T01:19:45.016 INFO:teuthology.orchestra.run.trial118.stdout:(166/173): NetworkManager-libnm-1.54.3-2.el9.x8 1.8 MB/s | 1.9 MB 00:01 2026-02-13T01:19:45.021 INFO:teuthology.orchestra.run.trial055.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 914 kB/s | 22 kB 00:00 2026-02-13T01:19:45.025 INFO:teuthology.orchestra.run.trial040.stdout:(63/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 17 MB/s | 78 MB 00:04 2026-02-13T01:19:45.026 INFO:teuthology.orchestra.run.trial040.stdout:(64/173): elfutils-libelf-devel-0.194-1.el9.x86 104 kB/s | 79 kB 00:00 2026-02-13T01:19:45.033 INFO:teuthology.orchestra.run.trial055.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 4.9 MB/s | 58 kB 00:00 2026-02-13T01:19:45.041 INFO:teuthology.orchestra.run.trial055.stdout:(84/173): openblas-openmp-0.3.29-1.el9.x86_64.r 106 MB/s | 5.3 MB 00:00 2026-02-13T01:19:45.044 INFO:teuthology.orchestra.run.trial055.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 4.2 MB/s | 45 kB 00:00 2026-02-13T01:19:45.061 INFO:teuthology.orchestra.run.trial055.stdout:(86/173): postgresql-contrib-13.23-1.el9.x86_64 52 MB/s | 903 kB 00:00 2026-02-13T01:19:45.073 INFO:teuthology.orchestra.run.trial055.stdout:(87/173): postgresql-private-libs-13.23-1.el9.x 11 MB/s | 138 kB 00:00 2026-02-13T01:19:45.117 INFO:teuthology.orchestra.run.trial055.stdout:(88/173): postgresql-server-13.23-1.el9.x86_64. 131 MB/s | 5.8 MB 00:00 2026-02-13T01:19:45.122 INFO:teuthology.orchestra.run.trial055.stdout:(89/173): postgresql-13.23-1.el9.x86_64.rpm 20 MB/s | 1.6 MB 00:00 2026-02-13T01:19:45.135 INFO:teuthology.orchestra.run.trial055.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 59 MB/s | 1.0 MB 00:00 2026-02-13T01:19:45.155 INFO:teuthology.orchestra.run.trial055.stdout:(91/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2026-02-13T01:19:45.157 INFO:teuthology.orchestra.run.trial055.stdout:(92/173): python3-colorama-0.4.6-3.el9.noarch.r 2.6 MB/s | 61 kB 00:00 2026-02-13T01:19:45.170 INFO:teuthology.orchestra.run.trial055.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 16 MB/s | 244 kB 00:00 2026-02-13T01:19:45.172 INFO:teuthology.orchestra.run.trial055.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 17 MB/s | 249 kB 00:00 2026-02-13T01:19:45.181 INFO:teuthology.orchestra.run.trial055.stdout:(95/173): python3-jmespath-1.0.1-1.el9.noarch.r 4.3 MB/s | 48 kB 00:00 2026-02-13T01:19:45.183 INFO:teuthology.orchestra.run.trial055.stdout:(96/173): python3-libstoragemgmt-1.10.1-1.el9.x 15 MB/s | 177 kB 00:00 2026-02-13T01:19:45.190 INFO:teuthology.orchestra.run.trial055.stdout:(97/173): python3-markupsafe-1.1.1-12.el9.x86_6 3.7 MB/s | 35 kB 00:00 2026-02-13T01:19:45.226 INFO:teuthology.orchestra.run.trial055.stdout:(98/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 12 MB/s | 442 kB 00:00 2026-02-13T01:19:45.233 INFO:teuthology.orchestra.run.trial055.stdout:(99/173): python3-numpy-1.23.5-2.el9.x86_64.rpm 123 MB/s | 6.1 MB 00:00 2026-02-13T01:19:45.236 INFO:teuthology.orchestra.run.trial055.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 7.6 MB/s | 77 kB 00:00 2026-02-13T01:19:45.249 INFO:teuthology.orchestra.run.trial055.stdout:(101/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 12 MB/s | 159 kB 00:00 2026-02-13T01:19:45.250 INFO:teuthology.orchestra.run.trial055.stdout:(102/173): python3-protobuf-3.14.0-17.el9.noarc 16 MB/s | 267 kB 00:00 2026-02-13T01:19:45.268 INFO:teuthology.orchestra.run.trial055.stdout:(103/173): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 6.0 MB 00:00 2026-02-13T01:19:45.268 INFO:teuthology.orchestra.run.trial055.stdout:(104/173): python3-requests-oauthlib-1.3.0-12.e 2.8 MB/s | 54 kB 00:00 2026-02-13T01:19:45.269 INFO:teuthology.orchestra.run.trial055.stdout:(105/173): python3-pyasn1-modules-0.4.8-6.el9.n 13 MB/s | 279 kB 00:00 2026-02-13T01:19:45.299 INFO:teuthology.orchestra.run.trial055.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 1.3 MB/s | 42 kB 00:00 2026-02-13T01:19:45.300 INFO:teuthology.orchestra.run.trial055.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 1.4 MB/s | 44 kB 00:00 2026-02-13T01:19:45.318 INFO:teuthology.orchestra.run.trial055.stdout:(108/173): qatlib-service-25.08.0-2.el9.x86_64. 2.0 MB/s | 37 kB 00:00 2026-02-13T01:19:45.320 INFO:teuthology.orchestra.run.trial055.stdout:(109/173): qatlib-25.08.0-2.el9.x86_64.rpm 11 MB/s | 240 kB 00:00 2026-02-13T01:19:45.334 INFO:teuthology.orchestra.run.trial055.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 4.3 MB/s | 66 kB 00:00 2026-02-13T01:19:45.339 INFO:teuthology.orchestra.run.trial118.stdout:(167/173): NetworkManager-tui-1.54.3-2.el9.x86_ 322 kB/s | 248 kB 00:00 2026-02-13T01:19:45.341 INFO:teuthology.orchestra.run.trial055.stdout:(111/173): socat-1.7.4.1-8.el9.x86_64.rpm 14 MB/s | 303 kB 00:00 2026-02-13T01:19:45.346 INFO:teuthology.orchestra.run.trial055.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 4.7 MB/s | 58 kB 00:00 2026-02-13T01:19:45.356 INFO:teuthology.orchestra.run.trial055.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 6.1 MB/s | 96 kB 00:00 2026-02-13T01:19:45.364 INFO:teuthology.orchestra.run.trial055.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 3.4 MB/s | 64 kB 00:00 2026-02-13T01:19:45.371 INFO:teuthology.orchestra.run.trial055.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 3.0 MB/s | 45 kB 00:00 2026-02-13T01:19:45.388 INFO:teuthology.orchestra.run.trial055.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 944 kB/s | 22 kB 00:00 2026-02-13T01:19:45.433 INFO:teuthology.orchestra.run.trial055.stdout:(117/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 117 MB/s | 19 MB 00:00 2026-02-13T01:19:45.456 INFO:teuthology.orchestra.run.trial055.stdout:(118/173): protobuf-compiler-3.14.0-17.el9.x86_ 9.9 MB/s | 862 kB 00:00 2026-02-13T01:19:45.551 INFO:teuthology.orchestra.run.trial055.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 207 kB/s | 19 kB 00:00 2026-02-13T01:19:45.576 INFO:teuthology.orchestra.run.trial055.stdout:(120/173): abseil-cpp-20211102.0-4.el9.x86_64.r 2.9 MB/s | 551 kB 00:00 2026-02-13T01:19:45.596 INFO:teuthology.orchestra.run.trial055.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-13T01:19:45.611 INFO:teuthology.orchestra.run.trial040.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 56 kB/s | 33 kB 00:00 2026-02-13T01:19:45.616 INFO:teuthology.orchestra.run.trial055.stdout:(122/173): liboath-2.6.12-1.el9.x86_64.rpm 2.4 MB/s | 49 kB 00:00 2026-02-13T01:19:45.636 INFO:teuthology.orchestra.run.trial055.stdout:(123/173): gperftools-libs-2.9.1-3.el9.x86_64.r 1.5 MB/s | 308 kB 00:00 2026-02-13T01:19:45.637 INFO:teuthology.orchestra.run.trial055.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 3.2 MB/s | 67 kB 00:00 2026-02-13T01:19:45.671 INFO:teuthology.orchestra.run.trial055.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 4.2 MB/s | 151 kB 00:00 2026-02-13T01:19:45.679 INFO:teuthology.orchestra.run.trial055.stdout:(126/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 20 MB/s | 838 kB 00:00 2026-02-13T01:19:45.698 INFO:teuthology.orchestra.run.trial055.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 1.5 MB/s | 29 kB 00:00 2026-02-13T01:19:45.711 INFO:teuthology.orchestra.run.trial055.stdout:(128/173): libarrow-9.0.0-15.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2026-02-13T01:19:45.717 INFO:teuthology.orchestra.run.trial055.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 3.0 MB/s | 60 kB 00:00 2026-02-13T01:19:45.730 INFO:teuthology.orchestra.run.trial055.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.2 MB/s | 43 kB 00:00 2026-02-13T01:19:45.731 INFO:teuthology.orchestra.run.trial055.stdout:(131/173): python3-asyncssh-2.13.2-5.el9.noarch 8.9 MB/s | 548 kB 00:00 2026-02-13T01:19:45.737 INFO:teuthology.orchestra.run.trial055.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 1.6 MB/s | 32 kB 00:00 2026-02-13T01:19:45.749 INFO:teuthology.orchestra.run.trial055.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 737 kB/s | 14 kB 00:00 2026-02-13T01:19:45.750 INFO:teuthology.orchestra.run.trial040.stdout:(66/173): flex-2.6.4-9.el9.x86_64.rpm 342 kB/s | 313 kB 00:00 2026-02-13T01:19:45.759 INFO:teuthology.orchestra.run.trial055.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 16 MB/s | 358 kB 00:00 2026-02-13T01:19:45.761 INFO:teuthology.orchestra.run.trial055.stdout:(135/173): python3-cheroot-10.0.1-4.el9.noarch. 5.7 MB/s | 173 kB 00:00 2026-02-13T01:19:45.770 INFO:teuthology.orchestra.run.trial055.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 14 MB/s | 303 kB 00:00 2026-02-13T01:19:45.781 INFO:teuthology.orchestra.run.trial055.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 12 MB/s | 254 kB 00:00 2026-02-13T01:19:45.790 INFO:teuthology.orchestra.run.trial055.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 7.1 MB/s | 144 kB 00:00 2026-02-13T01:19:45.800 INFO:teuthology.orchestra.run.trial055.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 562 kB/s | 11 kB 00:00 2026-02-13T01:19:45.809 INFO:teuthology.orchestra.run.trial055.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 924 kB/s | 18 kB 00:00 2026-02-13T01:19:45.822 INFO:teuthology.orchestra.run.trial055.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 1.0 MB/s | 23 kB 00:00 2026-02-13T01:19:45.828 INFO:teuthology.orchestra.run.trial055.stdout:(142/173): python3-jaraco-context-6.0.1-3.el9.n 1.0 MB/s | 20 kB 00:00 2026-02-13T01:19:45.837 INFO:teuthology.orchestra.run.trial055.stdout:(143/173): python3-grpcio-1.46.7-10.el9.x86_64. 27 MB/s | 2.0 MB 00:00 2026-02-13T01:19:45.841 INFO:teuthology.orchestra.run.trial055.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 1.0 MB/s | 19 kB 00:00 2026-02-13T01:19:45.848 INFO:teuthology.orchestra.run.trial055.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 1.3 MB/s | 26 kB 00:00 2026-02-13T01:19:45.863 INFO:teuthology.orchestra.run.trial055.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 3.5 MB/s | 79 kB 00:00 2026-02-13T01:19:45.867 INFO:teuthology.orchestra.run.trial055.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 2.9 MB/s | 58 kB 00:00 2026-02-13T01:19:45.873 INFO:teuthology.orchestra.run.trial055.stdout:(148/173): python3-kubernetes-26.1.0-3.el9.noar 28 MB/s | 1.0 MB 00:00 2026-02-13T01:19:45.882 INFO:teuthology.orchestra.run.trial055.stdout:(149/173): python3-portend-3.1.0-2.el9.noarch.r 855 kB/s | 16 kB 00:00 2026-02-13T01:19:45.887 INFO:teuthology.orchestra.run.trial055.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 4.5 MB/s | 90 kB 00:00 2026-02-13T01:19:45.899 INFO:teuthology.orchestra.run.trial055.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 1.0 MB/s | 28 kB 00:00 2026-02-13T01:19:45.902 INFO:teuthology.orchestra.run.trial055.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 1.6 MB/s | 31 kB 00:00 2026-02-13T01:19:45.907 INFO:teuthology.orchestra.run.trial055.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 9.2 MB/s | 188 kB 00:00 2026-02-13T01:19:45.921 INFO:teuthology.orchestra.run.trial055.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 1.8 MB/s | 36 kB 00:00 2026-02-13T01:19:45.924 INFO:teuthology.orchestra.run.trial118.stdout:(168/173): iproute-6.17.0-2.el9.x86_64.rpm 954 kB/s | 866 kB 00:00 2026-02-13T01:19:45.926 INFO:teuthology.orchestra.run.trial055.stdout:(155/173): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2026-02-13T01:19:45.927 INFO:teuthology.orchestra.run.trial055.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 4.2 MB/s | 86 kB 00:00 2026-02-13T01:19:45.941 INFO:teuthology.orchestra.run.trial055.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 4.4 MB/s | 90 kB 00:00 2026-02-13T01:19:45.946 INFO:teuthology.orchestra.run.trial055.stdout:(158/173): python3-zc-lockfile-2.0-10.el9.noarc 1.0 MB/s | 20 kB 00:00 2026-02-13T01:19:45.953 INFO:teuthology.orchestra.run.trial055.stdout:(159/173): python3-xmltodict-0.12.0-15.el9.noar 840 kB/s | 22 kB 00:00 2026-02-13T01:19:45.963 INFO:teuthology.orchestra.run.trial055.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 8.5 MB/s | 191 kB 00:00 2026-02-13T01:19:45.972 INFO:teuthology.orchestra.run.trial055.stdout:(161/173): thrift-0.15.0-4.el9.x86_64.rpm 61 MB/s | 1.6 MB 00:00 2026-02-13T01:19:45.980 INFO:teuthology.orchestra.run.trial055.stdout:(162/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 4.4 MB/s | 122 kB 00:00 2026-02-13T01:19:46.083 INFO:teuthology.orchestra.run.trial040.stdout:(67/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2026-02-13T01:19:46.098 INFO:teuthology.orchestra.run.trial040.stdout:(68/173): flexiblas-openblas-openmp-3.0.4-8.el9 37 kB/s | 18 kB 00:00 2026-02-13T01:19:46.142 INFO:teuthology.orchestra.run.trial055.stdout:(163/173): librados2-20.3.0-5241.g8f8d3829.el9. 19 MB/s | 3.5 MB 00:00 2026-02-13T01:19:46.146 INFO:teuthology.orchestra.run.trial055.stdout:(164/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 16 MB/s | 2.8 MB 00:00 2026-02-13T01:19:46.178 INFO:teuthology.orchestra.run.trial118.stdout:(169/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 541 kB/s | 454 kB 00:00 2026-02-13T01:19:46.224 INFO:teuthology.orchestra.run.trial040.stdout:(69/173): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2026-02-13T01:19:46.332 INFO:teuthology.orchestra.run.trial055.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 199 kB/s | 37 kB 00:00 2026-02-13T01:19:46.520 INFO:teuthology.orchestra.run.trial055.stdout:(166/173): NetworkManager-1.54.3-2.el9.x86_64.r 4.4 MB/s | 2.4 MB 00:00 2026-02-13T01:19:46.668 INFO:teuthology.orchestra.run.trial055.stdout:(167/173): NetworkManager-tui-1.54.3-2.el9.x86_ 739 kB/s | 248 kB 00:00 2026-02-13T01:19:46.804 INFO:teuthology.orchestra.run.trial040.stdout:(70/173): libnbd-1.20.3-4.el9.x86_64.rpm 227 kB/s | 164 kB 00:00 2026-02-13T01:19:46.809 INFO:teuthology.orchestra.run.trial040.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2026-02-13T01:19:46.820 INFO:teuthology.orchestra.run.trial040.stdout:(72/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 222 kB/s | 160 kB 00:00 2026-02-13T01:19:46.864 INFO:teuthology.orchestra.run.trial055.stdout:(168/173): NetworkManager-libnm-1.54.3-2.el9.x8 2.6 MB/s | 1.9 MB 00:00 2026-02-13T01:19:46.897 INFO:teuthology.orchestra.run.trial118.stdout:(170/173): openssl-3.5.5-1.el9.x86_64.rpm 1.5 MB/s | 1.5 MB 00:00 2026-02-13T01:19:46.917 INFO:teuthology.orchestra.run.trial118.stdout:(171/173): NetworkManager-1.54.3-2.el9.x86_64.r 782 kB/s | 2.4 MB 00:03 2026-02-13T01:19:46.977 INFO:teuthology.orchestra.run.trial055.stdout:(169/173): iproute-6.17.0-2.el9.x86_64.rpm 1.9 MB/s | 866 kB 00:00 2026-02-13T01:19:47.031 INFO:teuthology.orchestra.run.trial055.stdout:(170/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 1.2 MB/s | 454 kB 00:00 2026-02-13T01:19:47.087 INFO:teuthology.orchestra.run.trial118.stdout:(172/173): openssl-fips-provider-3.5.5-1.el9.x8 895 kB/s | 814 kB 00:00 2026-02-13T01:19:47.553 INFO:teuthology.orchestra.run.trial055.stdout:(171/173): openssl-fips-provider-3.5.5-1.el9.x8 1.4 MB/s | 814 kB 00:00 2026-02-13T01:19:47.584 INFO:teuthology.orchestra.run.trial040.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 318 kB/s | 246 kB 00:00 2026-02-13T01:19:47.691 INFO:teuthology.orchestra.run.trial040.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 667 kB/s | 581 kB 00:00 2026-02-13T01:19:47.703 INFO:teuthology.orchestra.run.trial040.stdout:(75/173): librdkafka-1.6.1-102.el9.x86_64.rpm 737 kB/s | 662 kB 00:00 2026-02-13T01:19:47.739 INFO:teuthology.orchestra.run.trial055.stdout:(172/173): openssl-3.5.5-1.el9.x86_64.rpm 1.7 MB/s | 1.5 MB 00:00 2026-02-13T01:19:47.857 INFO:teuthology.orchestra.run.trial055.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 2.8 MB/s | 2.3 MB 00:00 2026-02-13T01:19:47.862 INFO:teuthology.orchestra.run.trial055.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:19:47.863 INFO:teuthology.orchestra.run.trial055.stdout:Total 22 MB/s | 302 MB 00:13 2026-02-13T01:19:47.924 INFO:teuthology.orchestra.run.trial118.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 2.2 MB/s | 2.3 MB 00:01 2026-02-13T01:19:47.927 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:19:47.927 INFO:teuthology.orchestra.run.trial118.stdout:Total 21 MB/s | 302 MB 00:14 2026-02-13T01:19:48.126 INFO:teuthology.orchestra.run.trial040.stdout:(76/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 45 kB/s | 25 kB 00:00 2026-02-13T01:19:48.307 INFO:teuthology.orchestra.run.trial040.stdout:(77/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 84 kB/s | 51 kB 00:00 2026-02-13T01:19:48.452 INFO:teuthology.orchestra.run.trial040.stdout:(78/173): libxslt-1.1.34-12.el9.x86_64.rpm 306 kB/s | 233 kB 00:00 2026-02-13T01:19:48.637 INFO:teuthology.orchestra.run.trial055.stdout:Running transaction check 2026-02-13T01:19:48.708 INFO:teuthology.orchestra.run.trial055.stdout:Transaction check succeeded. 2026-02-13T01:19:48.708 INFO:teuthology.orchestra.run.trial055.stdout:Running transaction test 2026-02-13T01:19:48.737 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-13T01:19:48.809 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-13T01:19:48.809 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-13T01:19:48.909 INFO:teuthology.orchestra.run.trial040.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 374 kB/s | 292 kB 00:00 2026-02-13T01:19:49.038 INFO:teuthology.orchestra.run.trial040.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 72 kB/s | 42 kB 00:00 2026-02-13T01:19:49.047 INFO:teuthology.orchestra.run.trial040.stdout:(81/173): lua-5.4.4-4.el9.x86_64.rpm 254 kB/s | 188 kB 00:00 2026-02-13T01:19:49.593 INFO:teuthology.orchestra.run.trial040.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 41 kB/s | 22 kB 00:00 2026-02-13T01:19:49.805 INFO:teuthology.orchestra.run.trial055.stdout:Transaction test succeeded. 2026-02-13T01:19:49.805 INFO:teuthology.orchestra.run.trial055.stdout:Running transaction 2026-02-13T01:19:49.897 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-13T01:19:49.897 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-13T01:19:50.024 INFO:teuthology.orchestra.run.trial040.stdout:(83/173): openblas-openmp-0.3.29-1.el9.x86_64.r 4.7 MB/s | 5.3 MB 00:01 2026-02-13T01:19:50.151 INFO:teuthology.orchestra.run.trial040.stdout:(84/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 4.3 MB/s | 4.8 MB 00:01 2026-02-13T01:19:50.202 INFO:teuthology.orchestra.run.trial040.stdout:(85/173): perl-threads-2.25-460.el9.x86_64.rpm 96 kB/s | 58 kB 00:00 2026-02-13T01:19:50.609 INFO:teuthology.orchestra.run.trial040.stdout:(86/173): perl-threads-shared-1.61-460.el9.x86_ 76 kB/s | 45 kB 00:00 2026-02-13T01:19:50.972 INFO:teuthology.orchestra.run.trial055.stdout: Preparing : 1/1 2026-02-13T01:19:50.975 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T01:19:50.983 INFO:teuthology.orchestra.run.trial055.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T01:19:50.995 INFO:teuthology.orchestra.run.trial055.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T01:19:50.999 INFO:teuthology.orchestra.run.trial055.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T01:19:51.001 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T01:19:51.005 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T01:19:51.046 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T01:19:51.052 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T01:19:51.067 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-13T01:19:51.070 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T01:19:51.078 INFO:teuthology.orchestra.run.trial118.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T01:19:51.090 INFO:teuthology.orchestra.run.trial118.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T01:19:51.091 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:19:51.094 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:19:51.094 INFO:teuthology.orchestra.run.trial118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T01:19:51.096 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T01:19:51.101 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T01:19:51.113 INFO:teuthology.orchestra.run.trial040.stdout:(87/173): postgresql-contrib-13.23-1.el9.x86_64 991 kB/s | 903 kB 00:00 2026-02-13T01:19:51.131 INFO:teuthology.orchestra.run.trial040.stdout:(88/173): postgresql-13.23-1.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2026-02-13T01:19:51.145 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T01:19:51.149 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T01:19:51.184 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:19:51.187 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:19:51.199 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:19:51.203 INFO:teuthology.orchestra.run.trial055.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T01:19:51.234 INFO:teuthology.orchestra.run.trial055.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T01:19:51.257 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T01:19:51.268 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T01:19:51.273 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T01:19:51.278 INFO:teuthology.orchestra.run.trial055.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T01:19:51.284 INFO:teuthology.orchestra.run.trial055.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T01:19:51.286 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T01:19:51.291 INFO:teuthology.orchestra.run.trial055.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T01:19:51.292 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:19:51.296 INFO:teuthology.orchestra.run.trial118.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T01:19:51.315 INFO:teuthology.orchestra.run.trial055.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T01:19:51.321 INFO:teuthology.orchestra.run.trial040.stdout:(89/173): postgresql-private-libs-13.23-1.el9.x 194 kB/s | 138 kB 00:00 2026-02-13T01:19:51.327 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T01:19:51.328 INFO:teuthology.orchestra.run.trial118.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T01:19:51.333 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T01:19:51.336 INFO:teuthology.orchestra.run.trial055.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T01:19:51.342 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T01:19:51.344 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T01:19:51.346 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T01:19:51.350 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T01:19:51.356 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T01:19:51.361 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T01:19:51.364 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T01:19:51.370 INFO:teuthology.orchestra.run.trial118.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T01:19:51.376 INFO:teuthology.orchestra.run.trial118.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T01:19:51.379 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T01:19:51.383 INFO:teuthology.orchestra.run.trial118.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T01:19:51.391 INFO:teuthology.orchestra.run.trial055.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T01:19:51.395 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T01:19:51.397 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T01:19:51.398 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:19:51.406 INFO:teuthology.orchestra.run.trial118.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T01:19:51.419 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T01:19:51.420 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:19:51.425 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T01:19:51.427 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T01:19:51.428 INFO:teuthology.orchestra.run.trial118.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T01:19:51.434 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T01:19:51.436 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T01:19:51.437 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T01:19:51.447 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T01:19:51.451 INFO:teuthology.orchestra.run.trial055.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T01:19:51.456 INFO:teuthology.orchestra.run.trial055.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T01:19:51.458 INFO:teuthology.orchestra.run.trial055.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T01:19:51.461 INFO:teuthology.orchestra.run.trial055.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T01:19:51.464 INFO:teuthology.orchestra.run.trial055.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T01:19:51.482 INFO:teuthology.orchestra.run.trial118.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T01:19:51.486 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T01:19:51.488 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T01:19:51.489 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:19:51.492 INFO:teuthology.orchestra.run.trial055.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T01:19:51.512 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:19:51.519 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T01:19:51.543 INFO:teuthology.orchestra.run.trial118.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T01:19:51.545 INFO:teuthology.orchestra.run.trial055.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T01:19:51.548 INFO:teuthology.orchestra.run.trial118.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T01:19:51.550 INFO:teuthology.orchestra.run.trial118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T01:19:51.553 INFO:teuthology.orchestra.run.trial118.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T01:19:51.556 INFO:teuthology.orchestra.run.trial118.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T01:19:51.558 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T01:19:51.563 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T01:19:51.571 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T01:19:51.583 INFO:teuthology.orchestra.run.trial118.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T01:19:51.589 INFO:teuthology.orchestra.run.trial055.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T01:19:51.596 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T01:19:51.635 INFO:teuthology.orchestra.run.trial118.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T01:19:51.648 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T01:19:51.654 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T01:19:51.661 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T01:19:51.679 INFO:teuthology.orchestra.run.trial118.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T01:19:51.685 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T01:19:51.746 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T01:19:51.750 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:19:51.838 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T01:19:51.842 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:19:51.887 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:19:51.888 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:19:51.937 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:19:51.938 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:19:51.966 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:19:51.969 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T01:19:51.976 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:19:51.977 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:19:51.977 INFO:teuthology.orchestra.run.trial055.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T01:19:51.980 INFO:teuthology.orchestra.run.trial055.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T01:19:52.024 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:19:52.025 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:19:52.042 INFO:teuthology.orchestra.run.trial055.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T01:19:52.051 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:19:52.053 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T01:19:52.055 INFO:teuthology.orchestra.run.trial055.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T01:19:52.061 INFO:teuthology.orchestra.run.trial118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T01:19:52.064 INFO:teuthology.orchestra.run.trial118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T01:19:52.064 INFO:teuthology.orchestra.run.trial040.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2026-02-13T01:19:52.065 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T01:19:52.065 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:19:52.087 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:19:52.088 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:19:52.115 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:19:52.123 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T01:19:52.124 INFO:teuthology.orchestra.run.trial118.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T01:19:52.131 INFO:teuthology.orchestra.run.trial055.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T01:19:52.137 INFO:teuthology.orchestra.run.trial118.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T01:19:52.145 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T01:19:52.146 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:19:52.146 INFO:teuthology.orchestra.run.trial055.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T01:19:52.169 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:19:52.170 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:19:52.197 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:19:52.204 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T01:19:52.205 INFO:teuthology.orchestra.run.trial055.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T01:19:52.213 INFO:teuthology.orchestra.run.trial118.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T01:19:52.225 INFO:teuthology.orchestra.run.trial118.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T01:19:52.236 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T01:19:52.243 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T01:19:52.244 INFO:teuthology.orchestra.run.trial040.stdout:(91/173): postgresql-server-13.23-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2026-02-13T01:19:52.246 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T01:19:52.261 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T01:19:52.265 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T01:19:52.270 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T01:19:52.282 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T01:19:52.282 INFO:teuthology.orchestra.run.trial118.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T01:19:52.287 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T01:19:52.296 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T01:19:52.300 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T01:19:52.308 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T01:19:52.313 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T01:19:52.319 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T01:19:52.322 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T01:19:52.337 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T01:19:52.342 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T01:19:52.347 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T01:19:52.349 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T01:19:52.358 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T01:19:52.363 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T01:19:52.372 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T01:19:52.376 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T01:19:52.384 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T01:19:52.425 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T01:19:52.463 INFO:teuthology.orchestra.run.trial040.stdout:(92/173): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2026-02-13T01:19:52.681 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T01:19:52.691 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T01:19:52.695 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T01:19:52.700 INFO:teuthology.orchestra.run.trial040.stdout:(93/173): python3-colorama-0.4.6-3.el9.noarch.r 96 kB/s | 61 kB 00:00 2026-02-13T01:19:52.701 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T01:19:52.704 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T01:19:52.711 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T01:19:52.714 INFO:teuthology.orchestra.run.trial055.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T01:19:52.715 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T01:19:52.744 INFO:teuthology.orchestra.run.trial055.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T01:19:52.751 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T01:19:52.761 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T01:19:52.765 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T01:19:52.771 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T01:19:52.775 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T01:19:52.780 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T01:19:52.783 INFO:teuthology.orchestra.run.trial118.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T01:19:52.784 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T01:19:52.788 INFO:teuthology.orchestra.run.trial055.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T01:19:52.792 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T01:19:52.796 INFO:teuthology.orchestra.run.trial055.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T01:19:52.802 INFO:teuthology.orchestra.run.trial055.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T01:19:52.813 INFO:teuthology.orchestra.run.trial118.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T01:19:52.830 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T01:19:52.837 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T01:19:52.840 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T01:19:52.846 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T01:19:52.850 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T01:19:52.856 INFO:teuthology.orchestra.run.trial118.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T01:19:52.857 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T01:19:52.860 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T01:19:52.861 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T01:19:52.863 INFO:teuthology.orchestra.run.trial118.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T01:19:52.870 INFO:teuthology.orchestra.run.trial118.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T01:19:52.889 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T01:19:52.898 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T01:19:52.898 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T01:19:52.904 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T01:19:52.904 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T01:19:52.908 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T01:19:52.911 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T01:19:52.913 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T01:19:52.917 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T01:19:52.924 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T01:19:52.928 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T01:19:52.947 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:19:52.955 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T01:19:52.957 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T01:19:52.965 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T01:19:52.971 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T01:19:52.978 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T01:19:53.013 INFO:teuthology.orchestra.run.trial040.stdout:(94/173): python3-devel-3.9.25-2.el9.x86_64.rpm 318 kB/s | 244 kB 00:00 2026-02-13T01:19:53.013 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:19:53.024 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T01:19:53.186 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T01:19:53.209 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T01:19:53.213 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T01:19:53.232 INFO:teuthology.orchestra.run.trial040.stdout:(95/173): python3-jinja2-2.11.3-8.el9.noarch.rp 323 kB/s | 249 kB 00:00 2026-02-13T01:19:53.248 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T01:19:53.271 INFO:teuthology.orchestra.run.trial055.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T01:19:53.273 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T01:19:53.273 INFO:teuthology.orchestra.run.trial055.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T01:19:53.277 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T01:19:53.290 INFO:teuthology.orchestra.run.trial040.stdout:(96/173): python3-jmespath-1.0.1-1.el9.noarch.r 81 kB/s | 48 kB 00:00 2026-02-13T01:19:53.294 INFO:teuthology.orchestra.run.trial055.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T01:19:53.335 INFO:teuthology.orchestra.run.trial118.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T01:19:53.337 INFO:teuthology.orchestra.run.trial118.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T01:19:53.358 INFO:teuthology.orchestra.run.trial118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T01:19:53.627 INFO:teuthology.orchestra.run.trial055.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T01:19:53.686 INFO:teuthology.orchestra.run.trial118.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T01:19:53.702 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T01:19:53.746 INFO:teuthology.orchestra.run.trial040.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 242 kB/s | 177 kB 00:00 2026-02-13T01:19:53.759 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T01:19:53.798 INFO:teuthology.orchestra.run.trial040.stdout:(98/173): python3-markupsafe-1.1.1-12.el9.x86_6 61 kB/s | 35 kB 00:00 2026-02-13T01:19:54.388 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T01:19:54.403 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T01:19:54.406 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T01:19:54.408 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T01:19:54.414 INFO:teuthology.orchestra.run.trial055.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T01:19:54.421 INFO:teuthology.orchestra.run.trial040.stdout:(99/173): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.4 MB/s | 6.1 MB 00:01 2026-02-13T01:19:54.433 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T01:19:54.442 INFO:teuthology.orchestra.run.trial040.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 120 kB/s | 77 kB 00:00 2026-02-13T01:19:54.448 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T01:19:54.451 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T01:19:54.453 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T01:19:54.459 INFO:teuthology.orchestra.run.trial118.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T01:19:54.582 INFO:teuthology.orchestra.run.trial040.stdout:(101/173): python3-numpy-f2py-1.23.5-2.el9.x86_ 529 kB/s | 442 kB 00:00 2026-02-13T01:19:54.696 INFO:teuthology.orchestra.run.trial055.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T01:19:54.697 INFO:teuthology.orchestra.run.trial055.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:19:54.716 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:19:54.718 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T01:19:54.748 INFO:teuthology.orchestra.run.trial118.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T01:19:54.750 INFO:teuthology.orchestra.run.trial118.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:19:54.768 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:19:54.770 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T01:19:55.167 INFO:teuthology.orchestra.run.trial040.stdout:(102/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 219 kB/s | 159 kB 00:00 2026-02-13T01:19:55.201 INFO:teuthology.orchestra.run.trial040.stdout:(103/173): python3-protobuf-3.14.0-17.el9.noarc 343 kB/s | 267 kB 00:00 2026-02-13T01:19:55.367 INFO:teuthology.orchestra.run.trial040.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 355 kB/s | 279 kB 00:00 2026-02-13T01:19:55.772 INFO:teuthology.orchestra.run.trial040.stdout:(105/173): python3-requests-oauthlib-1.3.0-12.e 89 kB/s | 54 kB 00:00 2026-02-13T01:19:55.811 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:19:55.813 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:19:55.833 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:19:55.848 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T01:19:55.866 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T01:19:55.892 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:19:55.894 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:19:55.914 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:19:55.928 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T01:19:55.944 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T01:19:55.945 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T01:19:55.946 INFO:teuthology.orchestra.run.trial040.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2026-02-13T01:19:55.954 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T01:19:55.978 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T01:19:56.008 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T01:19:56.020 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T01:19:56.029 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T01:19:56.053 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T01:19:56.060 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T01:19:56.066 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T01:19:56.070 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T01:19:56.076 INFO:teuthology.orchestra.run.trial055.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T01:19:56.078 INFO:teuthology.orchestra.run.trial055.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T01:19:56.079 INFO:teuthology.orchestra.run.trial055.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:19:56.083 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T01:19:56.097 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:19:56.134 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T01:19:56.140 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T01:19:56.144 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T01:19:56.148 INFO:teuthology.orchestra.run.trial118.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T01:19:56.150 INFO:teuthology.orchestra.run.trial118.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T01:19:56.151 INFO:teuthology.orchestra.run.trial118.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:19:56.170 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:19:56.347 INFO:teuthology.orchestra.run.trial055.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T01:19:56.351 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:19:56.359 INFO:teuthology.orchestra.run.trial040.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 75 kB/s | 44 kB 00:00 2026-02-13T01:19:56.391 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:19:56.391 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T01:19:56.391 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T01:19:56.391 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:19:56.395 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:19:56.424 INFO:teuthology.orchestra.run.trial118.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T01:19:56.428 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:19:56.465 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:19:56.466 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T01:19:56.466 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T01:19:56.466 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:19:56.470 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:19:56.488 INFO:teuthology.orchestra.run.trial040.stdout:(108/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 15 MB/s | 19 MB 00:01 2026-02-13T01:19:56.707 INFO:teuthology.orchestra.run.trial040.stdout:(109/173): qatlib-25.08.0-2.el9.x86_64.rpm 315 kB/s | 240 kB 00:00 2026-02-13T01:19:56.935 INFO:teuthology.orchestra.run.trial040.stdout:(110/173): qatlib-service-25.08.0-2.el9.x86_64. 64 kB/s | 37 kB 00:00 2026-02-13T01:19:57.116 INFO:teuthology.orchestra.run.trial040.stdout:(111/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 106 kB/s | 66 kB 00:00 2026-02-13T01:19:57.500 INFO:teuthology.orchestra.run.trial040.stdout:(112/173): socat-1.7.4.1-8.el9.x86_64.rpm 383 kB/s | 303 kB 00:00 2026-02-13T01:19:57.545 INFO:teuthology.orchestra.run.trial040.stdout:(113/173): uuid-1.6.2-55.el9.x86_64.rpm 95 kB/s | 58 kB 00:00 2026-02-13T01:19:57.781 INFO:teuthology.orchestra.run.trial040.stdout:(114/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 144 kB/s | 96 kB 00:00 2026-02-13T01:19:57.847 INFO:teuthology.orchestra.run.trial040.stdout:(115/173): lua-devel-5.4.4-4.el9.x86_64.rpm 342 kB/s | 22 kB 00:00 2026-02-13T01:19:57.988 INFO:teuthology.orchestra.run.trial040.stdout:(116/173): protobuf-compiler-3.14.0-17.el9.x86_ 5.9 MB/s | 862 kB 00:00 2026-02-13T01:19:58.071 INFO:teuthology.orchestra.run.trial040.stdout:(117/173): abseil-cpp-20211102.0-4.el9.x86_64.r 6.6 MB/s | 551 kB 00:00 2026-02-13T01:19:58.095 INFO:teuthology.orchestra.run.trial040.stdout:(118/173): gperftools-libs-2.9.1-3.el9.x86_64.r 13 MB/s | 308 kB 00:00 2026-02-13T01:19:58.102 INFO:teuthology.orchestra.run.trial040.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 2.8 MB/s | 19 kB 00:00 2026-02-13T01:19:58.128 INFO:teuthology.orchestra.run.trial040.stdout:(120/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 101 kB/s | 64 kB 00:00 2026-02-13T01:19:58.131 INFO:teuthology.orchestra.run.trial040.stdout:(121/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2026-02-13T01:19:58.142 INFO:teuthology.orchestra.run.trial040.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.7 MB/s | 25 kB 00:00 2026-02-13T01:19:58.147 INFO:teuthology.orchestra.run.trial040.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 3.0 MB/s | 49 kB 00:00 2026-02-13T01:19:58.169 INFO:teuthology.orchestra.run.trial040.stdout:(124/173): libarrow-9.0.0-15.el9.x86_64.rpm 66 MB/s | 4.4 MB 00:00 2026-02-13T01:19:58.170 INFO:teuthology.orchestra.run.trial040.stdout:(125/173): libunwind-1.6.2-1.el9.x86_64.rpm 2.4 MB/s | 67 kB 00:00 2026-02-13T01:19:58.171 INFO:teuthology.orchestra.run.trial040.stdout:(126/173): luarocks-3.9.2-5.el9.noarch.rpm 6.2 MB/s | 151 kB 00:00 2026-02-13T01:19:58.177 INFO:teuthology.orchestra.run.trial040.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 4.7 MB/s | 29 kB 00:00 2026-02-13T01:19:58.182 INFO:teuthology.orchestra.run.trial040.stdout:(128/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 63 MB/s | 838 kB 00:00 2026-02-13T01:19:58.184 INFO:teuthology.orchestra.run.trial040.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 8.8 MB/s | 60 kB 00:00 2026-02-13T01:19:58.189 INFO:teuthology.orchestra.run.trial040.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 6.2 MB/s | 43 kB 00:00 2026-02-13T01:19:58.195 INFO:teuthology.orchestra.run.trial040.stdout:(131/173): python3-asyncssh-2.13.2-5.el9.noarch 21 MB/s | 548 kB 00:00 2026-02-13T01:19:58.196 INFO:teuthology.orchestra.run.trial040.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 2.0 MB/s | 14 kB 00:00 2026-02-13T01:19:58.211 INFO:teuthology.orchestra.run.trial040.stdout:(133/173): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2026-02-13T01:19:58.216 INFO:teuthology.orchestra.run.trial040.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 8.4 MB/s | 173 kB 00:00 2026-02-13T01:19:58.227 INFO:teuthology.orchestra.run.trial040.stdout:(135/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 19 MB/s | 303 kB 00:00 2026-02-13T01:19:58.238 INFO:teuthology.orchestra.run.trial040.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 11 MB/s | 254 kB 00:00 2026-02-13T01:19:58.243 INFO:teuthology.orchestra.run.trial040.stdout:(137/173): python3-cherrypy-18.6.1-2.el9.noarch 7.4 MB/s | 358 kB 00:00 2026-02-13T01:19:58.245 INFO:teuthology.orchestra.run.trial040.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 20 MB/s | 144 kB 00:00 2026-02-13T01:19:58.253 INFO:teuthology.orchestra.run.trial040.stdout:(139/173): python3-jaraco-classes-3.2.1-5.el9.n 2.2 MB/s | 18 kB 00:00 2026-02-13T01:19:58.255 INFO:teuthology.orchestra.run.trial040.stdout:(140/173): python3-jaraco-8.2.1-3.el9.noarch.rp 916 kB/s | 11 kB 00:00 2026-02-13T01:19:58.260 INFO:teuthology.orchestra.run.trial040.stdout:(141/173): python3-grpcio-1.46.7-10.el9.x86_64. 61 MB/s | 2.0 MB 00:00 2026-02-13T01:19:58.268 INFO:teuthology.orchestra.run.trial040.stdout:(142/173): python3-jaraco-context-6.0.1-3.el9.n 1.5 MB/s | 20 kB 00:00 2026-02-13T01:19:58.294 INFO:teuthology.orchestra.run.trial040.stdout:(143/173): python3-jaraco-collections-3.0.0-8.e 560 kB/s | 23 kB 00:00 2026-02-13T01:19:58.296 INFO:teuthology.orchestra.run.trial040.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 547 kB/s | 19 kB 00:00 2026-02-13T01:19:58.307 INFO:teuthology.orchestra.run.trial040.stdout:(145/173): python3-more-itertools-8.12.0-2.el9. 7.3 MB/s | 79 kB 00:00 2026-02-13T01:19:58.312 INFO:teuthology.orchestra.run.trial040.stdout:(146/173): python3-kubernetes-26.1.0-3.el9.noar 57 MB/s | 1.0 MB 00:00 2026-02-13T01:19:58.316 INFO:teuthology.orchestra.run.trial040.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 6.1 MB/s | 58 kB 00:00 2026-02-13T01:19:58.320 INFO:teuthology.orchestra.run.trial040.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 2.3 MB/s | 16 kB 00:00 2026-02-13T01:19:58.324 INFO:teuthology.orchestra.run.trial040.stdout:(149/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 12 MB/s | 90 kB 00:00 2026-02-13T01:19:58.330 INFO:teuthology.orchestra.run.trial040.stdout:(150/173): python3-pyperclip-1.8.2-2.el9.noarch 2.6 MB/s | 28 kB 00:00 2026-02-13T01:19:58.331 INFO:teuthology.orchestra.run.trial040.stdout:(151/173): python3-repoze-lru-0.7-16.el9.noarch 4.2 MB/s | 31 kB 00:00 2026-02-13T01:19:58.341 INFO:teuthology.orchestra.run.trial040.stdout:(152/173): python3-rsa-4.9-2.el9.noarch.rpm 6.0 MB/s | 59 kB 00:00 2026-02-13T01:19:58.343 INFO:teuthology.orchestra.run.trial040.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 15 MB/s | 188 kB 00:00 2026-02-13T01:19:58.349 INFO:teuthology.orchestra.run.trial040.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 4.2 MB/s | 36 kB 00:00 2026-02-13T01:19:58.350 INFO:teuthology.orchestra.run.trial040.stdout:(155/173): python3-typing-extensions-4.15.0-1.e 12 MB/s | 86 kB 00:00 2026-02-13T01:19:58.357 INFO:teuthology.orchestra.run.trial040.stdout:(156/173): python3-xmltodict-0.12.0-15.el9.noar 3.6 MB/s | 22 kB 00:00 2026-02-13T01:19:58.357 INFO:teuthology.orchestra.run.trial040.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 11 MB/s | 90 kB 00:00 2026-02-13T01:19:58.496 INFO:teuthology.orchestra.run.trial040.stdout:(158/173): python3-jaraco-text-4.0.0-2.el9.noar 116 kB/s | 26 kB 00:00 2026-02-13T01:19:58.547 INFO:teuthology.orchestra.run.trial040.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 105 kB/s | 20 kB 00:00 2026-02-13T01:19:58.550 INFO:teuthology.orchestra.run.trial040.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 997 kB/s | 191 kB 00:00 2026-02-13T01:19:58.556 INFO:teuthology.orchestra.run.trial040.stdout:(161/173): thrift-0.15.0-4.el9.x86_64.rpm 26 MB/s | 1.6 MB 00:00 2026-02-13T01:19:58.721 INFO:teuthology.orchestra.run.trial040.stdout:(162/173): librados2-20.3.0-5241.g8f8d3829.el9. 20 MB/s | 3.5 MB 00:00 2026-02-13T01:19:58.738 INFO:teuthology.orchestra.run.trial040.stdout:(163/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 16 MB/s | 2.8 MB 00:00 2026-02-13T01:19:58.748 INFO:teuthology.orchestra.run.trial040.stdout:(164/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 607 kB/s | 122 kB 00:00 2026-02-13T01:19:58.811 INFO:teuthology.orchestra.run.trial040.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 586 kB/s | 37 kB 00:00 2026-02-13T01:19:58.851 INFO:teuthology.orchestra.run.trial040.stdout:(166/173): NetworkManager-libnm-1.54.3-2.el9.x8 17 MB/s | 1.9 MB 00:00 2026-02-13T01:19:58.856 INFO:teuthology.orchestra.run.trial040.stdout:(167/173): NetworkManager-tui-1.54.3-2.el9.x86_ 5.4 MB/s | 248 kB 00:00 2026-02-13T01:19:58.869 INFO:teuthology.orchestra.run.trial040.stdout:(168/173): NetworkManager-1.54.3-2.el9.x86_64.r 16 MB/s | 2.4 MB 00:00 2026-02-13T01:19:58.878 INFO:teuthology.orchestra.run.trial040.stdout:(169/173): iproute-6.17.0-2.el9.x86_64.rpm 30 MB/s | 866 kB 00:00 2026-02-13T01:19:58.901 INFO:teuthology.orchestra.run.trial040.stdout:(170/173): openssl-3.5.5-1.el9.x86_64.rpm 47 MB/s | 1.5 MB 00:00 2026-02-13T01:19:58.906 INFO:teuthology.orchestra.run.trial040.stdout:(171/173): openssl-fips-provider-3.5.5-1.el9.x8 29 MB/s | 814 kB 00:00 2026-02-13T01:19:58.908 INFO:teuthology.orchestra.run.trial040.stdout:(172/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 8.5 MB/s | 454 kB 00:00 2026-02-13T01:19:58.972 INFO:teuthology.orchestra.run.trial040.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 32 MB/s | 2.3 MB 00:00 2026-02-13T01:19:58.975 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:19:58.975 INFO:teuthology.orchestra.run.trial040.stdout:Total 14 MB/s | 302 MB 00:21 2026-02-13T01:20:00.475 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-13T01:20:00.571 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-13T01:20:00.571 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-13T01:20:01.165 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:20:01.165 INFO:teuthology.orchestra.run.trial055.stdout:skipping the directory /sys 2026-02-13T01:20:01.165 INFO:teuthology.orchestra.run.trial055.stdout:skipping the directory /proc 2026-02-13T01:20:01.165 INFO:teuthology.orchestra.run.trial055.stdout:skipping the directory /mnt 2026-02-13T01:20:01.165 INFO:teuthology.orchestra.run.trial055.stdout:skipping the directory /var/tmp 2026-02-13T01:20:01.165 INFO:teuthology.orchestra.run.trial055.stdout:skipping the directory /home 2026-02-13T01:20:01.165 INFO:teuthology.orchestra.run.trial055.stdout:skipping the directory /root 2026-02-13T01:20:01.165 INFO:teuthology.orchestra.run.trial055.stdout:skipping the directory /tmp 2026-02-13T01:20:01.165 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:01.214 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:20:01.214 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /sys 2026-02-13T01:20:01.214 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /proc 2026-02-13T01:20:01.214 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /mnt 2026-02-13T01:20:01.215 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /var/tmp 2026-02-13T01:20:01.215 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /home 2026-02-13T01:20:01.215 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /root 2026-02-13T01:20:01.215 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /tmp 2026-02-13T01:20:01.215 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:01.267 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:20:01.289 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:20:01.290 INFO:teuthology.orchestra.run.trial055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:01.290 INFO:teuthology.orchestra.run.trial055.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T01:20:01.290 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:20:01.290 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:20:01.290 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:01.319 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:20:01.342 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:20:01.342 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:01.342 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T01:20:01.342 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:20:01.342 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:20:01.342 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:01.503 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:20:01.525 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:20:01.525 INFO:teuthology.orchestra.run.trial055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:01.525 INFO:teuthology.orchestra.run.trial055.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T01:20:01.525 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:20:01.525 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:20:01.525 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:01.531 INFO:teuthology.orchestra.run.trial055.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T01:20:01.533 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T01:20:01.550 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:20:01.551 INFO:teuthology.orchestra.run.trial055.stdout:Creating group 'qat' with GID 992. 2026-02-13T01:20:01.551 INFO:teuthology.orchestra.run.trial055.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T01:20:01.551 INFO:teuthology.orchestra.run.trial055.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T01:20:01.551 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:01.558 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:20:01.559 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:20:01.580 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:20:01.580 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:01.580 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T01:20:01.580 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:20:01.580 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:20:01.580 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:01.582 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:20:01.582 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T01:20:01.582 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:01.586 INFO:teuthology.orchestra.run.trial118.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T01:20:01.587 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T01:20:01.606 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:20:01.606 INFO:teuthology.orchestra.run.trial118.stdout:Creating group 'qat' with GID 992. 2026-02-13T01:20:01.606 INFO:teuthology.orchestra.run.trial118.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T01:20:01.606 INFO:teuthology.orchestra.run.trial118.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T01:20:01.607 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:01.615 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:20:01.617 INFO:teuthology.orchestra.run.trial055.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T01:20:01.639 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:20:01.639 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T01:20:01.639 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:01.674 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T01:20:01.832 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-13T01:20:01.832 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-13T01:20:02.237 INFO:teuthology.orchestra.run.trial055.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T01:20:02.308 INFO:teuthology.orchestra.run.trial118.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T01:20:02.994 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T01:20:03.057 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T01:20:03.059 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:20:03.072 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:20:03.072 INFO:teuthology.orchestra.run.trial055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:03.072 INFO:teuthology.orchestra.run.trial055.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T01:20:03.072 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:03.082 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T01:20:03.084 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:20:03.106 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:20:03.106 INFO:teuthology.orchestra.run.trial055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:03.106 INFO:teuthology.orchestra.run.trial055.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T01:20:03.107 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:20:03.107 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:20:03.107 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:03.145 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T01:20:03.147 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:20:03.162 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:20:03.162 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:03.162 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T01:20:03.162 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:03.164 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:20:03.166 INFO:teuthology.orchestra.run.trial055.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:20:03.170 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-13T01:20:03.174 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:20:03.175 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T01:20:03.175 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T01:20:03.186 INFO:teuthology.orchestra.run.trial040.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T01:20:03.198 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:20:03.198 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:03.198 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T01:20:03.198 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:20:03.198 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:20:03.199 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:03.199 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T01:20:03.200 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:20:03.205 INFO:teuthology.orchestra.run.trial040.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T01:20:03.212 INFO:teuthology.orchestra.run.trial040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T01:20:03.216 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T01:20:03.224 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T01:20:03.261 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:20:03.263 INFO:teuthology.orchestra.run.trial118.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:20:03.272 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T01:20:03.286 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T01:20:03.291 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T01:20:03.296 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T01:20:03.297 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:20:03.351 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:20:03.357 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:20:03.512 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:20:03.518 INFO:teuthology.orchestra.run.trial040.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T01:20:03.558 INFO:teuthology.orchestra.run.trial040.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T01:20:03.592 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T01:20:03.609 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T01:20:03.617 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T01:20:03.626 INFO:teuthology.orchestra.run.trial040.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T01:20:03.635 INFO:teuthology.orchestra.run.trial040.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T01:20:03.641 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T01:20:03.649 INFO:teuthology.orchestra.run.trial040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T01:20:03.684 INFO:teuthology.orchestra.run.trial040.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T01:20:03.704 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T01:20:03.715 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T01:20:03.720 INFO:teuthology.orchestra.run.trial040.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T01:20:03.729 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T01:20:03.732 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T01:20:03.734 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T01:20:03.749 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T01:20:03.800 INFO:teuthology.orchestra.run.trial040.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T01:20:03.807 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T01:20:03.810 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T01:20:03.812 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:20:03.853 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:20:03.865 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T01:20:03.902 INFO:teuthology.orchestra.run.trial040.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T01:20:03.911 INFO:teuthology.orchestra.run.trial040.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T01:20:03.915 INFO:teuthology.orchestra.run.trial040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T01:20:03.920 INFO:teuthology.orchestra.run.trial040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T01:20:03.925 INFO:teuthology.orchestra.run.trial040.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T01:20:03.966 INFO:teuthology.orchestra.run.trial040.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T01:20:04.041 INFO:teuthology.orchestra.run.trial040.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T01:20:04.061 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T01:20:04.071 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T01:20:04.083 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T01:20:04.109 INFO:teuthology.orchestra.run.trial040.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T01:20:04.119 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T01:20:04.285 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T01:20:04.288 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:20:04.447 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:20:04.450 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:20:04.515 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:20:04.518 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:20:04.559 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:20:04.563 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T01:20:04.575 INFO:teuthology.orchestra.run.trial040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T01:20:04.580 INFO:teuthology.orchestra.run.trial040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T01:20:04.668 INFO:teuthology.orchestra.run.trial040.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T01:20:04.688 INFO:teuthology.orchestra.run.trial040.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T01:20:04.697 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T01:20:04.699 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:20:04.734 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:20:04.736 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:20:04.769 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:20:04.776 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:20:04.777 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:20:04.786 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T01:20:04.799 INFO:teuthology.orchestra.run.trial040.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T01:20:04.818 INFO:teuthology.orchestra.run.trial040.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T01:20:04.873 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:20:04.880 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:20:04.915 INFO:teuthology.orchestra.run.trial040.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T01:20:04.966 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T01:20:04.978 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T01:20:04.983 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T01:20:05.005 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T01:20:05.013 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T01:20:05.022 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T01:20:05.040 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T01:20:05.049 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T01:20:05.063 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T01:20:05.071 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T01:20:05.083 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T01:20:05.143 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T01:20:05.231 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:20:05.232 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:20:05.294 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:20:05.336 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T01:20:05.337 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:20:05.338 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:20:05.339 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:20:05.358 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:20:05.358 INFO:teuthology.orchestra.run.trial055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:05.358 INFO:teuthology.orchestra.run.trial055.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T01:20:05.359 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:20:05.359 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:20:05.359 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:05.370 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:20:05.380 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:20:05.402 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:20:05.446 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T01:20:05.447 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:20:05.469 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:20:05.469 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:05.469 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T01:20:05.469 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:20:05.469 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:20:05.469 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:05.480 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:20:05.490 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:20:05.605 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T01:20:05.624 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T01:20:05.631 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T01:20:05.641 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T01:20:05.648 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T01:20:05.658 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T01:20:05.662 INFO:teuthology.orchestra.run.trial040.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T01:20:05.665 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T01:20:05.711 INFO:teuthology.orchestra.run.trial040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T01:20:05.778 INFO:teuthology.orchestra.run.trial040.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T01:20:05.786 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T01:20:05.792 INFO:teuthology.orchestra.run.trial040.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T01:20:05.802 INFO:teuthology.orchestra.run.trial040.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T01:20:05.843 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T01:20:05.855 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T01:20:05.861 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T01:20:05.871 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T01:20:05.877 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T01:20:05.888 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T01:20:05.894 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T01:20:05.935 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T01:20:05.952 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T01:20:05.953 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T01:20:05.954 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:20:05.963 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T01:20:05.974 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T01:20:05.977 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:20:05.977 INFO:teuthology.orchestra.run.trial055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:05.977 INFO:teuthology.orchestra.run.trial055.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T01:20:05.977 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:20:05.977 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:20:05.977 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:05.986 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:20:06.006 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:20:06.006 INFO:teuthology.orchestra.run.trial055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:06.006 INFO:teuthology.orchestra.run.trial055.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T01:20:06.006 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:06.020 INFO:teuthology.orchestra.run.trial055.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:20:06.026 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:20:06.042 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:20:06.042 INFO:teuthology.orchestra.run.trial055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:06.042 INFO:teuthology.orchestra.run.trial055.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T01:20:06.042 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:20:06.042 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:20:06.042 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:06.044 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T01:20:06.073 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T01:20:06.075 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:20:06.097 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:20:06.097 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:06.097 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T01:20:06.097 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:20:06.097 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:20:06.097 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:06.106 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:20:06.127 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:20:06.127 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:06.127 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T01:20:06.127 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:06.141 INFO:teuthology.orchestra.run.trial118.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:20:06.163 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:20:06.163 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:06.163 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T01:20:06.163 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:20:06.163 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:20:06.163 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:06.167 INFO:teuthology.orchestra.run.trial055.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:20:06.188 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:20:06.188 INFO:teuthology.orchestra.run.trial055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:06.188 INFO:teuthology.orchestra.run.trial055.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T01:20:06.188 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:20:06.188 INFO:teuthology.orchestra.run.trial055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:20:06.188 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:06.291 INFO:teuthology.orchestra.run.trial118.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:20:06.312 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:20:06.312 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:06.312 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T01:20:06.312 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:20:06.312 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:20:06.312 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:06.345 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T01:20:06.384 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T01:20:06.391 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T01:20:06.464 INFO:teuthology.orchestra.run.trial040.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T01:20:06.468 INFO:teuthology.orchestra.run.trial040.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T01:20:06.495 INFO:teuthology.orchestra.run.trial040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T01:20:06.959 INFO:teuthology.orchestra.run.trial040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T01:20:07.074 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T01:20:08.034 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T01:20:08.066 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T01:20:08.071 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T01:20:08.074 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T01:20:08.083 INFO:teuthology.orchestra.run.trial040.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T01:20:08.389 INFO:teuthology.orchestra.run.trial040.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T01:20:08.392 INFO:teuthology.orchestra.run.trial040.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:20:08.427 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:20:08.430 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T01:20:09.617 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T01:20:09.631 INFO:teuthology.orchestra.run.trial055.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T01:20:09.634 INFO:teuthology.orchestra.run.trial055.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T01:20:09.670 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:20:09.677 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:20:09.709 INFO:teuthology.orchestra.run.trial055.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T01:20:09.716 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:20:09.728 INFO:teuthology.orchestra.run.trial055.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T01:20:09.732 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T01:20:09.734 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T01:20:09.737 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T01:20:09.761 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T01:20:09.819 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T01:20:09.833 INFO:teuthology.orchestra.run.trial118.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T01:20:09.837 INFO:teuthology.orchestra.run.trial118.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T01:20:09.854 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:20:09.858 INFO:teuthology.orchestra.run.trial055.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:20:09.876 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:20:09.876 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T01:20:09.880 INFO:teuthology.orchestra.run.trial055.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T01:20:09.890 INFO:teuthology.orchestra.run.trial055.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T01:20:09.893 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T01:20:09.911 INFO:teuthology.orchestra.run.trial118.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T01:20:09.928 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T01:20:09.930 INFO:teuthology.orchestra.run.trial118.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T01:20:09.932 INFO:teuthology.orchestra.run.trial055.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:20:09.935 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T01:20:09.936 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T01:20:09.973 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T01:20:10.047 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T01:20:10.057 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:20:10.058 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T01:20:10.060 INFO:teuthology.orchestra.run.trial118.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:20:10.065 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T01:20:10.072 INFO:teuthology.orchestra.run.trial040.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T01:20:10.076 INFO:teuthology.orchestra.run.trial040.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T01:20:10.078 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:20:10.078 INFO:teuthology.orchestra.run.trial040.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:20:10.082 INFO:teuthology.orchestra.run.trial118.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T01:20:10.091 INFO:teuthology.orchestra.run.trial118.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T01:20:10.114 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:20:10.134 INFO:teuthology.orchestra.run.trial118.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:20:10.389 INFO:teuthology.orchestra.run.trial055.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T01:20:10.401 INFO:teuthology.orchestra.run.trial040.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T01:20:10.410 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:20:10.413 INFO:teuthology.orchestra.run.trial055.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T01:20:10.415 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T01:20:10.419 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:20:10.420 INFO:teuthology.orchestra.run.trial055.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T01:20:10.429 INFO:teuthology.orchestra.run.trial055.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T01:20:10.457 INFO:teuthology.orchestra.run.trial055.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T01:20:10.459 INFO:teuthology.orchestra.run.trial055.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T01:20:10.461 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:20:10.465 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T01:20:10.465 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:20:10.478 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:20:10.478 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:20:10.480 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:20:10.480 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T01:20:10.480 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T01:20:10.480 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:10.487 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:20:10.491 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:20:10.492 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T01:20:10.494 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T01:20:10.496 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T01:20:10.502 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:20:10.502 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:20:10.589 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T01:20:10.594 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:20:10.596 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T01:20:10.599 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T01:20:10.601 INFO:teuthology.orchestra.run.trial055.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:20:10.607 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T01:20:10.614 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:20:10.614 INFO:teuthology.orchestra.run.trial118.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T01:20:10.616 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T01:20:10.619 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:20:10.620 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T01:20:10.630 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T01:20:10.637 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:20:10.657 INFO:teuthology.orchestra.run.trial118.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T01:20:10.660 INFO:teuthology.orchestra.run.trial118.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T01:20:10.662 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:20:10.666 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T01:20:10.666 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:20:10.679 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:20:10.679 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:20:10.692 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:20:10.694 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T01:20:10.696 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T01:20:10.697 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T01:20:10.703 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:20:10.703 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:20:10.797 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:20:10.799 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T01:20:10.802 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T01:20:10.804 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:20:10.810 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T01:20:10.817 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:20:10.842 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:20:11.578 INFO:teuthology.orchestra.run.trial055.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:20:11.578 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T01:20:11.578 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T01:20:11.578 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T01:20:11.579 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T01:20:11.580 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T01:20:11.581 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T01:20:11.582 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T01:20:11.583 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T01:20:11.584 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T01:20:11.585 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T01:20:11.586 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T01:20:11.587 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T01:20:11.588 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T01:20:11.589 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T01:20:11.590 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:20:11.591 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T01:20:11.592 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T01:20:11.593 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T01:20:11.593 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T01:20:11.593 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T01:20:11.593 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T01:20:11.593 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T01:20:11.644 INFO:teuthology.orchestra.run.trial055.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:20:11.644 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:11.644 INFO:teuthology.orchestra.run.trial055.stdout:Upgraded: 2026-02-13T01:20:11.644 INFO:teuthology.orchestra.run.trial055.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:11.645 INFO:teuthology.orchestra.run.trial055.stdout:Installed: 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.646 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.647 INFO:teuthology.orchestra.run.trial055.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T01:20:11.648 INFO:teuthology.orchestra.run.trial055.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T01:20:11.649 INFO:teuthology.orchestra.run.trial055.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T01:20:11.650 INFO:teuthology.orchestra.run.trial055.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T01:20:11.651 INFO:teuthology.orchestra.run.trial055.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T01:20:11.652 INFO:teuthology.orchestra.run.trial055.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T01:20:11.653 INFO:teuthology.orchestra.run.trial055.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:20:11.654 INFO:teuthology.orchestra.run.trial055.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T01:20:11.655 INFO:teuthology.orchestra.run.trial055.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T01:20:11.656 INFO:teuthology.orchestra.run.trial055.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T01:20:11.657 INFO:teuthology.orchestra.run.trial055.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T01:20:11.658 INFO:teuthology.orchestra.run.trial055.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T01:20:11.658 INFO:teuthology.orchestra.run.trial055.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T01:20:11.658 INFO:teuthology.orchestra.run.trial055.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T01:20:11.658 INFO:teuthology.orchestra.run.trial055.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T01:20:11.658 INFO:teuthology.orchestra.run.trial055.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T01:20:11.658 INFO:teuthology.orchestra.run.trial055.stdout: zip-3.0-35.el9.x86_64 2026-02-13T01:20:11.658 INFO:teuthology.orchestra.run.trial055.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T01:20:11.658 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:20:11.658 INFO:teuthology.orchestra.run.trial055.stdout:Complete! 2026-02-13T01:20:11.748 DEBUG:teuthology.parallel:result is None 2026-02-13T01:20:11.755 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:20:11.755 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T01:20:11.755 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T01:20:11.755 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T01:20:11.755 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T01:20:11.755 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T01:20:11.755 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T01:20:11.755 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T01:20:11.755 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T01:20:11.756 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T01:20:11.757 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T01:20:11.758 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T01:20:11.759 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T01:20:11.760 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T01:20:11.761 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:20:11.762 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T01:20:11.763 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T01:20:11.764 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T01:20:11.765 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T01:20:11.766 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T01:20:11.767 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:20:11.768 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T01:20:11.769 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T01:20:11.769 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T01:20:11.769 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T01:20:11.769 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T01:20:11.769 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T01:20:11.769 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T01:20:11.769 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T01:20:11.769 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T01:20:11.815 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:20:11.815 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:11.815 INFO:teuthology.orchestra.run.trial118.stdout:Upgraded: 2026-02-13T01:20:11.815 INFO:teuthology.orchestra.run.trial118.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:11.816 INFO:teuthology.orchestra.run.trial118.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:11.816 INFO:teuthology.orchestra.run.trial118.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:11.816 INFO:teuthology.orchestra.run.trial118.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:11.816 INFO:teuthology.orchestra.run.trial118.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T01:20:11.816 INFO:teuthology.orchestra.run.trial118.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T01:20:11.816 INFO:teuthology.orchestra.run.trial118.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.816 INFO:teuthology.orchestra.run.trial118.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.817 INFO:teuthology.orchestra.run.trial118.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:11.817 INFO:teuthology.orchestra.run.trial118.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:11.817 INFO:teuthology.orchestra.run.trial118.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:11.817 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-13T01:20:11.817 INFO:teuthology.orchestra.run.trial118.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T01:20:11.817 INFO:teuthology.orchestra.run.trial118.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T01:20:11.817 INFO:teuthology.orchestra.run.trial118.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T01:20:11.817 INFO:teuthology.orchestra.run.trial118.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.818 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:11.819 INFO:teuthology.orchestra.run.trial118.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T01:20:11.820 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T01:20:11.821 INFO:teuthology.orchestra.run.trial118.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T01:20:11.822 INFO:teuthology.orchestra.run.trial118.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T01:20:11.823 INFO:teuthology.orchestra.run.trial118.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T01:20:11.824 INFO:teuthology.orchestra.run.trial118.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T01:20:11.825 INFO:teuthology.orchestra.run.trial118.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T01:20:11.826 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T01:20:11.827 INFO:teuthology.orchestra.run.trial118.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T01:20:11.828 INFO:teuthology.orchestra.run.trial118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T01:20:11.828 INFO:teuthology.orchestra.run.trial118.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T01:20:11.828 INFO:teuthology.orchestra.run.trial118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T01:20:11.828 INFO:teuthology.orchestra.run.trial118.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T01:20:11.828 INFO:teuthology.orchestra.run.trial118.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T01:20:11.828 INFO:teuthology.orchestra.run.trial118.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T01:20:11.828 INFO:teuthology.orchestra.run.trial118.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.828 INFO:teuthology.orchestra.run.trial118.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.828 INFO:teuthology.orchestra.run.trial118.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: zip-3.0-35.el9.x86_64 2026-02-13T01:20:11.829 INFO:teuthology.orchestra.run.trial118.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T01:20:11.830 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:20:11.830 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-13T01:20:11.911 DEBUG:teuthology.parallel:result is None 2026-02-13T01:20:16.503 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:20:16.503 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /sys 2026-02-13T01:20:16.504 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /proc 2026-02-13T01:20:16.504 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /mnt 2026-02-13T01:20:16.504 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /var/tmp 2026-02-13T01:20:16.504 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /home 2026-02-13T01:20:16.504 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /root 2026-02-13T01:20:16.504 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /tmp 2026-02-13T01:20:16.504 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:16.618 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:20:16.665 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:20:16.665 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:16.665 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T01:20:16.665 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:20:16.665 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:20:16.665 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:16.904 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:20:16.952 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:20:16.952 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:16.952 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T01:20:16.952 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:20:16.952 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:20:16.952 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:16.962 INFO:teuthology.orchestra.run.trial040.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T01:20:16.965 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T01:20:17.002 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:20:17.002 INFO:teuthology.orchestra.run.trial040.stdout:Creating group 'qat' with GID 992. 2026-02-13T01:20:17.002 INFO:teuthology.orchestra.run.trial040.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T01:20:17.003 INFO:teuthology.orchestra.run.trial040.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T01:20:17.003 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:17.016 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:20:17.067 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:20:17.067 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T01:20:17.067 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:17.119 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T01:20:17.793 INFO:teuthology.orchestra.run.trial040.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T01:20:18.605 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T01:20:18.693 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T01:20:18.698 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:20:18.730 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:20:18.730 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:18.730 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T01:20:18.730 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:18.744 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:20:18.796 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:20:18.797 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:18.797 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T01:20:18.797 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:20:18.797 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:20:18.797 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:18.917 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:20:18.920 INFO:teuthology.orchestra.run.trial040.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:20:18.933 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T01:20:18.965 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T01:20:18.969 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:20:20.853 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:20:20.868 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:20:21.379 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:20:21.382 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:20:21.476 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:20:21.525 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T01:20:21.528 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:20:21.575 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:20:21.575 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:21.575 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T01:20:21.575 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:20:21.575 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:20:21.575 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:21.593 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:20:21.613 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:20:22.237 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T01:20:22.242 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:20:22.290 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:20:22.290 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:22.290 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T01:20:22.291 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:20:22.291 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:20:22.291 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:22.303 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:20:22.347 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:20:22.348 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:22.348 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T01:20:22.348 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:22.364 INFO:teuthology.orchestra.run.trial040.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:20:22.409 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:20:22.409 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:22.410 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T01:20:22.410 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:20:22.410 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:20:22.410 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:22.550 INFO:teuthology.orchestra.run.trial040.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:20:22.597 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:20:22.598 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:20:22.598 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T01:20:22.598 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:20:22.598 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:20:22.598 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:26.327 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T01:20:26.348 INFO:teuthology.orchestra.run.trial040.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T01:20:26.354 INFO:teuthology.orchestra.run.trial040.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T01:20:26.462 INFO:teuthology.orchestra.run.trial040.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T01:20:26.495 INFO:teuthology.orchestra.run.trial040.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T01:20:26.503 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T01:20:26.505 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T01:20:26.711 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:20:26.721 INFO:teuthology.orchestra.run.trial040.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:20:26.757 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:20:26.763 INFO:teuthology.orchestra.run.trial040.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T01:20:26.775 INFO:teuthology.orchestra.run.trial040.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T01:20:26.823 INFO:teuthology.orchestra.run.trial040.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:20:27.691 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T01:20:27.737 INFO:teuthology.orchestra.run.trial040.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T01:20:27.741 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T01:20:27.746 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:20:27.750 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T01:20:27.764 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T01:20:27.806 INFO:teuthology.orchestra.run.trial040.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T01:20:27.821 INFO:teuthology.orchestra.run.trial040.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T01:20:27.821 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:20:27.823 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T01:20:27.823 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:20:27.851 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:20:27.852 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:20:27.878 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:20:27.881 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T01:20:27.884 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T01:20:27.886 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T01:20:27.900 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:20:27.900 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:20:28.047 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:20:28.053 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T01:20:28.058 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T01:20:28.062 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:20:28.075 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T01:20:28.090 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:20:28.123 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:20:28.272 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:20:28.273 INFO:teuthology.orchestra.run.trial040.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-13T01:20:28.273 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:29.290 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T01:20:29.290 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T01:20:29.291 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T01:20:29.292 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T01:20:29.293 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T01:20:29.294 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T01:20:29.295 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T01:20:29.296 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T01:20:29.297 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:20:29.298 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T01:20:29.299 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T01:20:29.300 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T01:20:29.301 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T01:20:29.302 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T01:20:29.303 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:20:29.304 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T01:20:29.305 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T01:20:29.306 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T01:20:29.381 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:20:29.381 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:29.381 INFO:teuthology.orchestra.run.trial040.stdout:Upgraded: 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:29.382 INFO:teuthology.orchestra.run.trial040.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.383 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.384 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T01:20:29.385 INFO:teuthology.orchestra.run.trial040.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T01:20:29.386 INFO:teuthology.orchestra.run.trial040.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T01:20:29.387 INFO:teuthology.orchestra.run.trial040.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T01:20:29.388 INFO:teuthology.orchestra.run.trial040.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T01:20:29.389 INFO:teuthology.orchestra.run.trial040.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T01:20:29.390 INFO:teuthology.orchestra.run.trial040.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T01:20:29.391 INFO:teuthology.orchestra.run.trial040.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T01:20:29.392 INFO:teuthology.orchestra.run.trial040.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T01:20:29.393 INFO:teuthology.orchestra.run.trial040.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T01:20:29.393 INFO:teuthology.orchestra.run.trial040.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T01:20:29.393 INFO:teuthology.orchestra.run.trial040.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:20:29.393 INFO:teuthology.orchestra.run.trial040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T01:20:29.393 INFO:teuthology.orchestra.run.trial040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T01:20:29.393 INFO:teuthology.orchestra.run.trial040.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T01:20:29.393 INFO:teuthology.orchestra.run.trial040.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T01:20:29.393 INFO:teuthology.orchestra.run.trial040.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T01:20:29.393 INFO:teuthology.orchestra.run.trial040.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T01:20:29.394 INFO:teuthology.orchestra.run.trial040.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T01:20:29.394 INFO:teuthology.orchestra.run.trial040.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T01:20:29.394 INFO:teuthology.orchestra.run.trial040.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T01:20:29.394 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T01:20:29.394 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T01:20:29.394 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T01:20:29.394 INFO:teuthology.orchestra.run.trial040.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T01:20:29.394 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T01:20:29.394 INFO:teuthology.orchestra.run.trial040.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T01:20:29.395 INFO:teuthology.orchestra.run.trial040.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T01:20:29.396 INFO:teuthology.orchestra.run.trial040.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T01:20:29.397 INFO:teuthology.orchestra.run.trial040.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T01:20:29.397 INFO:teuthology.orchestra.run.trial040.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T01:20:29.397 INFO:teuthology.orchestra.run.trial040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T01:20:29.397 INFO:teuthology.orchestra.run.trial040.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T01:20:29.397 INFO:teuthology.orchestra.run.trial040.stdout: zip-3.0-35.el9.x86_64 2026-02-13T01:20:29.397 INFO:teuthology.orchestra.run.trial040.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T01:20:29.397 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:29.397 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-13T01:20:29.625 DEBUG:teuthology.parallel:result is None 2026-02-13T01:20:29.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:29.795 DEBUG:teuthology.orchestra.run.trial040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T01:20:29.838 INFO:teuthology.orchestra.run.trial040.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T01:20:29.838 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T01:20:29.839 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T01:20:29.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:29.997 DEBUG:teuthology.orchestra.run.trial055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T01:20:30.020 INFO:teuthology.orchestra.run.trial055.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T01:20:30.021 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T01:20:30.021 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T01:20:30.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:30.175 DEBUG:teuthology.orchestra.run.trial118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T01:20:30.198 INFO:teuthology.orchestra.run.trial118.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T01:20:30.198 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T01:20:30.198 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T01:20:30.201 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T01:20:30.201 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:20:30.201 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T01:20:30.258 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:20:30.259 DEBUG:teuthology.orchestra.run.trial055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T01:20:30.288 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:20:30.288 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T01:20:30.316 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T01:20:30.317 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:20:30.317 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T01:20:30.371 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T01:20:30.465 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:20:30.465 DEBUG:teuthology.orchestra.run.trial055:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T01:20:30.491 DEBUG:teuthology.orchestra.run.trial055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T01:20:30.557 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:20:30.557 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T01:20:30.584 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T01:20:30.650 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T01:20:30.650 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:20:30.650 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T01:20:30.705 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T01:20:30.801 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:20:30.801 DEBUG:teuthology.orchestra.run.trial055:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T01:20:30.828 DEBUG:teuthology.orchestra.run.trial055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T01:20:30.891 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:20:30.891 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T01:20:30.917 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T01:20:30.982 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T01:20:30.982 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:20:30.982 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T01:20:31.037 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T01:20:31.136 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:20:31.137 DEBUG:teuthology.orchestra.run.trial055:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T01:20:31.162 DEBUG:teuthology.orchestra.run.trial055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T01:20:31.226 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:20:31.226 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T01:20:31.252 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T01:20:31.316 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-13T01:20:31.446 INFO:tasks.cephadm:Config: {'distro-suffix': 'rockylinux-10', 'roleless': False, 'skip_dashboard': True, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True, 'fuse default permissions': False, 'fuse set user groups': True}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.2}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2026-02-13T01:20:31.446 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T01:20:31.450 INFO:tasks.cephadm:Cluster fsid is 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:31.450 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-13T01:20:31.450 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.40', 'mon.b': '10.20.193.55', 'mon.c': '10.20.193.118'} 2026-02-13T01:20:31.450 INFO:tasks.cephadm:First mon is mon.a on trial040 2026-02-13T01:20:31.450 INFO:tasks.cephadm:First mgr is x 2026-02-13T01:20:31.450 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-13T01:20:31.450 DEBUG:teuthology.orchestra.run.trial040:> sudo hostname $(hostname -s) 2026-02-13T01:20:31.506 DEBUG:teuthology.orchestra.run.trial055:> sudo hostname $(hostname -s) 2026-02-13T01:20:31.532 DEBUG:teuthology.orchestra.run.trial118:> sudo hostname $(hostname -s) 2026-02-13T01:20:31.558 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-13T01:20:31.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:31.718 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'ref': 'wip-pdonnell-testing-20260210.171210', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-10 22:03:44.386901', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5241-g8f8d3829', 'package_manager_version': '20.3.0-5241.g8f8d3829', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2911/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-13T01:20:31.863 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20260210.171210, sha1 8f8d38294e4db8750b4b1649f62ce37caa63080f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:31.865 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T01:20:31.865 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T01:20:31.865 DEBUG:teuthology.orchestra.run.trial040:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T01:20:32.228 INFO:teuthology.orchestra.run.trial040.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 01:20 /home/ubuntu/cephtest/cephadm 2026-02-13T01:20:32.229 DEBUG:teuthology.orchestra.run.trial055:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T01:20:32.569 INFO:teuthology.orchestra.run.trial055.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 01:20 /home/ubuntu/cephtest/cephadm 2026-02-13T01:20:32.569 DEBUG:teuthology.orchestra.run.trial118:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T01:20:32.889 INFO:teuthology.orchestra.run.trial118.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 01:20 /home/ubuntu/cephtest/cephadm 2026-02-13T01:20:32.890 DEBUG:teuthology.orchestra.run.trial040:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T01:20:32.931 DEBUG:teuthology.orchestra.run.trial055:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T01:20:32.950 DEBUG:teuthology.orchestra.run.trial118:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T01:20:32.994 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 on all hosts... 2026-02-13T01:20:32.994 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T01:20:32.998 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T01:20:33.001 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T01:20:33.159 INFO:teuthology.orchestra.run.trial055.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:20:33.174 INFO:teuthology.orchestra.run.trial118.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:20:33.354 INFO:teuthology.orchestra.run.trial040.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:20:44.043 INFO:teuthology.orchestra.run.trial055.stdout:{ 2026-02-13T01:20:44.043 INFO:teuthology.orchestra.run.trial055.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T01:20:44.043 INFO:teuthology.orchestra.run.trial055.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T01:20:44.044 INFO:teuthology.orchestra.run.trial055.stdout: "repo_digests": [ 2026-02-13T01:20:44.044 INFO:teuthology.orchestra.run.trial055.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T01:20:44.044 INFO:teuthology.orchestra.run.trial055.stdout: ] 2026-02-13T01:20:44.044 INFO:teuthology.orchestra.run.trial055.stdout:} 2026-02-13T01:20:44.051 INFO:teuthology.orchestra.run.trial118.stdout:{ 2026-02-13T01:20:44.051 INFO:teuthology.orchestra.run.trial118.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T01:20:44.051 INFO:teuthology.orchestra.run.trial118.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T01:20:44.051 INFO:teuthology.orchestra.run.trial118.stdout: "repo_digests": [ 2026-02-13T01:20:44.051 INFO:teuthology.orchestra.run.trial118.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T01:20:44.051 INFO:teuthology.orchestra.run.trial118.stdout: ] 2026-02-13T01:20:44.052 INFO:teuthology.orchestra.run.trial118.stdout:} 2026-02-13T01:20:48.587 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-13T01:20:48.587 INFO:teuthology.orchestra.run.trial040.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T01:20:48.587 INFO:teuthology.orchestra.run.trial040.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T01:20:48.587 INFO:teuthology.orchestra.run.trial040.stdout: "repo_digests": [ 2026-02-13T01:20:48.587 INFO:teuthology.orchestra.run.trial040.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T01:20:48.587 INFO:teuthology.orchestra.run.trial040.stdout: ] 2026-02-13T01:20:48.587 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-13T01:20:48.612 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /etc/ceph 2026-02-13T01:20:48.669 DEBUG:teuthology.orchestra.run.trial055:> sudo mkdir -p /etc/ceph 2026-02-13T01:20:48.698 DEBUG:teuthology.orchestra.run.trial118:> sudo mkdir -p /etc/ceph 2026-02-13T01:20:48.727 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 777 /etc/ceph 2026-02-13T01:20:48.783 DEBUG:teuthology.orchestra.run.trial055:> sudo chmod 777 /etc/ceph 2026-02-13T01:20:48.809 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod 777 /etc/ceph 2026-02-13T01:20:48.835 INFO:tasks.cephadm:Writing seed config... 2026-02-13T01:20:48.837 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [client] fuse default permissions = False 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [client] fuse set user groups = True 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.2 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-13T01:20:48.838 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-13T01:20:48.839 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-13T01:20:48.840 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-13T01:20:48.840 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2026-02-13T01:20:48.841 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:20:48.841 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-13T01:20:48.879 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 304b456c-087a-11f1-98ea-d404e6e7d460 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True fuse default permissions = False fuse set user groups = True [mds] mds_export_ephemeral_random_max = 0.2 2026-02-13T01:20:48.880 DEBUG:teuthology.orchestra.run.trial040:mon.a> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.a.service 2026-02-13T01:20:48.923 DEBUG:teuthology.orchestra.run.trial040:mgr.x> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.x.service 2026-02-13T01:20:48.968 INFO:tasks.cephadm:Bootstrapping... 2026-02-13T01:20:48.968 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 -v bootstrap --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.40 --skip-dashboard --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:20:49.159 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:20:49.159 INFO:teuthology.orchestra.run.trial040.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', '-v', 'bootstrap', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.40', '--skip-dashboard', '--skip-admin-label'] 2026-02-13T01:20:49.159 INFO:teuthology.orchestra.run.trial040.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-13T01:20:49.160 INFO:teuthology.orchestra.run.trial040.stdout:Verifying podman|docker is present... 2026-02-13T01:20:49.190 INFO:teuthology.orchestra.run.trial040.stdout:/bin/podman: stdout 5.6.0 2026-02-13T01:20:49.190 INFO:teuthology.orchestra.run.trial040.stdout:Verifying lvm2 is present... 2026-02-13T01:20:49.190 INFO:teuthology.orchestra.run.trial040.stdout:Verifying time synchronization is in place... 2026-02-13T01:20:49.204 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T01:20:49.204 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T01:20:49.214 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T01:20:49.214 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout inactive 2026-02-13T01:20:49.226 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout enabled 2026-02-13T01:20:49.236 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout active 2026-02-13T01:20:49.236 INFO:teuthology.orchestra.run.trial040.stdout:Unit chronyd.service is enabled and running 2026-02-13T01:20:49.237 INFO:teuthology.orchestra.run.trial040.stdout:Repeating the final host check... 2026-02-13T01:20:49.267 INFO:teuthology.orchestra.run.trial040.stdout:/bin/podman: stdout 5.6.0 2026-02-13T01:20:49.267 INFO:teuthology.orchestra.run.trial040.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-13T01:20:49.269 INFO:teuthology.orchestra.run.trial040.stdout:systemctl is present 2026-02-13T01:20:49.269 INFO:teuthology.orchestra.run.trial040.stdout:lvcreate is present 2026-02-13T01:20:49.280 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T01:20:49.280 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T01:20:49.290 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T01:20:49.290 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout inactive 2026-02-13T01:20:49.302 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout enabled 2026-02-13T01:20:49.312 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout active 2026-02-13T01:20:49.312 INFO:teuthology.orchestra.run.trial040.stdout:Unit chronyd.service is enabled and running 2026-02-13T01:20:49.312 INFO:teuthology.orchestra.run.trial040.stdout:Host looks OK 2026-02-13T01:20:49.312 INFO:teuthology.orchestra.run.trial040.stdout:Cluster fsid: 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:49.312 INFO:teuthology.orchestra.run.trial040.stdout:Acquiring lock 139924346269504 on /run/cephadm/304b456c-087a-11f1-98ea-d404e6e7d460.lock 2026-02-13T01:20:49.312 INFO:teuthology.orchestra.run.trial040.stdout:Lock 139924346269504 acquired on /run/cephadm/304b456c-087a-11f1-98ea-d404e6e7d460.lock 2026-02-13T01:20:49.313 INFO:teuthology.orchestra.run.trial040.stdout:Verifying IP 10.20.193.40 port 3300 ... 2026-02-13T01:20:49.313 INFO:teuthology.orchestra.run.trial040.stdout:Verifying IP 10.20.193.40 port 6789 ... 2026-02-13T01:20:49.313 INFO:teuthology.orchestra.run.trial040.stdout:Base mon IP(s) is [10.20.193.40:3300, 10.20.193.40:6789], mon addrv is [v2:10.20.193.40:3300,v1:10.20.193.40:6789] 2026-02-13T01:20:49.318 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.40 metric 100 2026-02-13T01:20:49.318 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.40 metric 100 2026-02-13T01:20:49.323 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-13T01:20:49.324 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0np0 proto kernel metric 256 pref medium 2026-02-13T01:20:49.330 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-13T01:20:49.330 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-13T01:20:49.330 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T01:20:49.330 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout 2: enp1s0f0np0: mtu 1500 state UP qlen 1000 2026-02-13T01:20:49.330 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:5e28/64 scope link proto kernel_ll 2026-02-13T01:20:49.330 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T01:20:49.331 INFO:teuthology.orchestra.run.trial040.stdout:Mon IP `10.20.193.40` is in CIDR network `10.20.192.0/20` 2026-02-13T01:20:49.331 INFO:teuthology.orchestra.run.trial040.stdout:Mon IP `10.20.193.40` is in CIDR network `10.20.192.0/20` 2026-02-13T01:20:49.331 INFO:teuthology.orchestra.run.trial040.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-13T01:20:49.331 INFO:teuthology.orchestra.run.trial040.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-13T01:20:49.331 INFO:teuthology.orchestra.run.trial040.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:20:49.635 INFO:teuthology.orchestra.run.trial040.stdout:/bin/podman: stdout b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T01:20:49.635 INFO:teuthology.orchestra.run.trial040.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:20:49.635 INFO:teuthology.orchestra.run.trial040.stdout:/bin/podman: stderr Getting image source signatures 2026-02-13T01:20:49.635 INFO:teuthology.orchestra.run.trial040.stdout:/bin/podman: stderr Copying blob sha256:9b7325f35ad40fc8a795fce82955bc486ff370c187eaa160f4df65d0fb22f2a2 2026-02-13T01:20:49.635 INFO:teuthology.orchestra.run.trial040.stdout:/bin/podman: stderr Copying blob sha256:0c53e9fad0324c188a40a9b1e0ca4eb777da2812507ec104055fa6ec400d9a27 2026-02-13T01:20:49.635 INFO:teuthology.orchestra.run.trial040.stdout:/bin/podman: stderr Copying config sha256:b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T01:20:49.636 INFO:teuthology.orchestra.run.trial040.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-13T01:20:49.886 INFO:teuthology.orchestra.run.trial040.stdout:ceph: stdout ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T01:20:49.886 INFO:teuthology.orchestra.run.trial040.stdout:Ceph version: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T01:20:49.886 INFO:teuthology.orchestra.run.trial040.stdout:Extracting ceph user uid/gid from container image... 2026-02-13T01:20:50.082 INFO:teuthology.orchestra.run.trial040.stdout:stat: stdout 167 167 2026-02-13T01:20:50.082 INFO:teuthology.orchestra.run.trial040.stdout:Creating initial keys... 2026-02-13T01:20:50.317 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph-authtool: stdout AQByfI5pO34eDRAAXOvLgBY5fWW3AjeIQWCKuA== 2026-02-13T01:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph-authtool: stdout AQByfI5p8WIIGhAAF29aWv4khUilKeJcm/7oDw== 2026-02-13T01:20:50.763 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph-authtool: stdout AQByfI5pz5S5JxAAHgYyDlkNxC6tWwbJ07aDNw== 2026-02-13T01:20:50.764 INFO:teuthology.orchestra.run.trial040.stdout:Creating initial monmap... 2026-02-13T01:20:50.950 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T01:20:50.950 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-13T01:20:50.950 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:50.950 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T01:20:50.951 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool for a [v2:10.20.193.40:3300,v1:10.20.193.40:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T01:20:50.951 INFO:teuthology.orchestra.run.trial040.stdout:setting min_mon_release = tentacle 2026-02-13T01:20:50.951 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/monmaptool: set fsid to 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:50.951 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T01:20:50.951 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:20:50.951 INFO:teuthology.orchestra.run.trial040.stdout:Creating mon... 2026-02-13T01:20:51.190 INFO:teuthology.orchestra.run.trial040.stdout:create mon.a on 2026-02-13T01:20:51.448 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-13T01:20:51.622 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-13T01:20:51.808 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-304b456c-087a-11f1-98ea-d404e6e7d460.target → /etc/systemd/system/ceph-304b456c-087a-11f1-98ea-d404e6e7d460.target. 2026-02-13T01:20:51.808 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-304b456c-087a-11f1-98ea-d404e6e7d460.target → /etc/systemd/system/ceph-304b456c-087a-11f1-98ea-d404e6e7d460.target. 2026-02-13T01:20:52.024 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.a 2026-02-13T01:20:52.024 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Failed to reset failed state of unit ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.a.service: Unit ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.a.service not loaded. 2026-02-13T01:20:52.265 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-304b456c-087a-11f1-98ea-d404e6e7d460.target.wants/ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-304b456c-087a-11f1-98ea-d404e6e7d460@.service. 2026-02-13T01:20:52.538 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T01:20:52.538 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout disabled 2026-02-13T01:20:52.549 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T01:20:52.549 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout inactive 2026-02-13T01:20:52.549 INFO:teuthology.orchestra.run.trial040.stdout:firewalld.service is not enabled 2026-02-13T01:20:52.549 INFO:teuthology.orchestra.run.trial040.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T01:20:52.549 INFO:teuthology.orchestra.run.trial040.stdout:Waiting for mon to start... 2026-02-13T01:20:52.549 INFO:teuthology.orchestra.run.trial040.stdout:Waiting for mon... 2026-02-13T01:20:52.559 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:52 trial040 systemd[1]: Started Ceph mon.a for 304b456c-087a-11f1-98ea-d404e6e7d460. 2026-02-13T01:20:52.827 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:52 trial040 ceph-mon[22684]: mkfs 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:52.827 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:52 trial040 ceph-mon[22684]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:20:52.862 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout cluster: 2026-02-13T01:20:52.862 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout id: 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:52.862 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout services: 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.22906s) [leader: a] 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout data: 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout pgs: 2026-02-13T01:20:52.863 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:52.864 INFO:teuthology.orchestra.run.trial040.stdout:mon is available 2026-02-13T01:20:52.864 INFO:teuthology.orchestra.run.trial040.stdout:Assimilating anything we can from ceph.conf... 2026-02-13T01:20:53.166 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:53.166 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T01:20:53.166 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout fsid = 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:53.166 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.40:3300,v1:10.20.193.40:6789] 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T01:20:53.167 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T01:20:53.168 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T01:20:53.168 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T01:20:53.168 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T01:20:53.168 INFO:teuthology.orchestra.run.trial040.stdout:Generating new minimal ceph.conf... 2026-02-13T01:20:53.457 INFO:teuthology.orchestra.run.trial040.stdout:Restarting the monitor... 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 systemd[1]: Stopping Ceph mon.a for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: monmap epoch 1 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: fsid 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: last_changed 2026-02-13T01:20:50.888496+0000 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: created 2026-02-13T01:20:50.888496+0000 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: min_mon_release 20 (tentacle) 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: election_strategy: 1 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: 0: [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon.a 2026-02-13T01:20:53.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: fsmap 2026-02-13T01:20:53.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T01:20:53.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: mgrmap e1: no daemons active 2026-02-13T01:20:53.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: from='client.? 10.20.193.40:0/799676882' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-13T01:20:53.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: from='client.? 10.20.193.40:0/458442707' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T01:20:53.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: from='client.? 10.20.193.40:0/458442707' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-13T01:20:53.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-mon[22684]: from='client.? 10.20.193.40:0/2706916210' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:20:53.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a[22680]: 2026-02-13T01:20:53.593+0000 7fc9fc1566c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:20:53.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a[22680]: 2026-02-13T01:20:53.593+0000 7fc9fc1566c0 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-13T01:20:53.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 podman[22922]: 2026-02-13 01:20:53.604908623 +0000 UTC m=+0.034254058 container died 6c0ff9e1fb6804c4573ca1232885de17c4c0144c451ffe1a1ea0d65982620c86 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a, name=rockylinux, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:20:53.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 podman[22922]: 2026-02-13 01:20:53.660815827 +0000 UTC m=+0.090161262 container remove 6c0ff9e1fb6804c4573ca1232885de17c4c0144c451ffe1a1ea0d65982620c86 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10) 2026-02-13T01:20:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 bash[22922]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a 2026-02-13T01:20:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 systemd[1]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-13T01:20:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 systemd[1]: Stopped Ceph mon.a for 304b456c-087a-11f1-98ea-d404e6e7d460. 2026-02-13T01:20:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:53 trial040 systemd[1]: Starting Ceph mon.a for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:20:54.125 INFO:teuthology.orchestra.run.trial040.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-13T01:20:54.369 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 podman[23026]: 2026-02-13 01:20:53.927350403 +0000 UTC m=+0.018235929 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T01:20:54.369 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 podman[23026]: 2026-02-13 01:20:54.062634182 +0000 UTC m=+0.153519708 container create 08dc632eeb58d2e95593624138b047c94fc0cdc5ab9663a38102452a3a7ba25d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, summary=Rocky Linux Base image, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:20:54.369 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 podman[23026]: 2026-02-13 01:20:54.107506666 +0000 UTC m=+0.198392182 container init 08dc632eeb58d2e95593624138b047c94fc0cdc5ab9663a38102452a3a7ba25d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a, org.opencontainers.image.version=10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, version=10, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:20:54.369 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 podman[23026]: 2026-02-13 01:20:54.11387644 +0000 UTC m=+0.204761956 container start 08dc632eeb58d2e95593624138b047c94fc0cdc5ab9663a38102452a3a7ba25d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, version=10, OSD_FLAVOR=default) 2026-02-13T01:20:54.369 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 bash[23026]: 08dc632eeb58d2e95593624138b047c94fc0cdc5ab9663a38102452a3a7ba25d 2026-02-13T01:20:54.369 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 systemd[1]: Started Ceph mon.a for 304b456c-087a-11f1-98ea-d404e6e7d460. 2026-02-13T01:20:54.369 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T01:20:54.369 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: pidfile_write: ignore empty --pid-file 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: load: jerasure load: lrc 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: RocksDB version: 7.9.2 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Git sha 0 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: DB SUMMARY 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: DB Session ID: PP468M6SS5FQ9HS4GVG5 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: CURRENT file: CURRENT 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-13T01:20:54.370 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 96185 ; 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.error_if_exists: 0 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.create_if_missing: 0 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.paranoid_checks: 1 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.env: 0x55ba7e1612c0 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.info_log: 0x55ba7ff38ee0 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T01:20:54.371 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.statistics: (nil) 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.use_fsync: 0 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_log_file_size: 0 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.allow_fallocate: 1 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.use_direct_reads: 0 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T01:20:54.372 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.db_log_dir: 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.wal_dir: 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.write_buffer_manager: 0x55ba7ff2fb80 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T01:20:54.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.unordered_write: 0 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.row_cache: None 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.wal_filter: None 2026-02-13T01:20:54.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.two_write_queues: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.wal_compression: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.atomic_flush: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.log_readahead_size: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T01:20:54.375 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_background_jobs: 2 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_background_compactions: -1 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_subcompactions: 1 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T01:20:54.376 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_open_files: -1 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_background_flushes: -1 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Compression algorithms supported: 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: kZSTD supported: 0 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: kXpressCompression supported: 0 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: kBZip2Compression supported: 0 2026-02-13T01:20:54.377 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: kLZ4Compression supported: 1 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: kZlibCompression supported: 1 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: kSnappyCompression supported: 1 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.merge_operator: 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_filter: None 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T01:20:54.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ba800b83e0) 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout: cache_index_and_filter_blocks: 1 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout: pin_top_level_index_and_filter: 1 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout: index_type: 0 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout: data_block_index_type: 0 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout: index_shortening: 1 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T01:20:54.379 INFO:journalctl@ceph.mon.a.trial040.stdout: checksum: 4 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: no_block_cache: 0 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: block_cache: 0x55ba7ff31690 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: block_cache_name: BinnedLRUCache 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: block_cache_options: 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: capacity : 536870912 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: num_shard_bits : 4 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: strict_capacity_limit : 0 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: high_pri_pool_ratio: 0.000 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: block_cache_compressed: (nil) 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: persistent_cache: (nil) 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: block_size: 4096 2026-02-13T01:20:54.380 INFO:journalctl@ceph.mon.a.trial040.stdout: block_size_deviation: 10 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: block_restart_interval: 16 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: index_block_restart_interval: 1 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: metadata_block_size: 4096 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: partition_filters: 0 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: use_delta_encoding: 1 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: filter_policy: bloomfilter 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: whole_key_filtering: 1 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: verify_compression: 0 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: read_amp_bytes_per_bit: 0 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: format_version: 5 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: enable_index_compression: 1 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: block_align: 0 2026-02-13T01:20:54.381 INFO:journalctl@ceph.mon.a.trial040.stdout: max_auto_readahead_size: 262144 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout: prepopulate_block_cache: 0 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout: initial_auto_readahead_size: 8192 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression: NoCompression 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.num_levels: 7 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T01:20:54.382 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T01:20:54.383 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T01:20:54.384 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T01:20:54.385 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T01:20:54.386 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.inplace_update_support: 0 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.bloom_locality: 0 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.max_successive_merges: 0 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.ttl: 2592000 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T01:20:54.387 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.enable_blob_files: false 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.min_blob_size: 0 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-13T01:20:54.388 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5779afdf-7031-49a4-b83d-e3ad252e4078 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945654148346, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945654150995, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92529, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 278, "table_properties": {"data_size": 90578, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11973, "raw_average_key_size": 48, "raw_value_size": 83832, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 245, "num_filter_entries": 245, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770945654, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5779afdf-7031-49a4-b83d-e3ad252e4078", "db_session_id": "PP468M6SS5FQ9HS4GVG5", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945654151105, "job": 1, "event": "recovery_finished"} 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ba7ff54e00 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: DB pointer 0x55ba80d5e000 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T01:20:54.389 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: ** DB Stats ** 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: ** Compaction Stats [default] ** 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T01:20:54.390 INFO:journalctl@ceph.mon.a.trial040.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: L0 2/0 92.23 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 39.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: Sum 2/0 92.23 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 39.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 39.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: ** Compaction Stats [default] ** 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 39.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: 2026-02-13T01:20:54.391 INFO:journalctl@ceph.mon.a.trial040.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: Cumulative compaction: 0.00 GB write, 14.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: Interval compaction: 0.00 GB write, 14.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: Block cache BinnedLRUCache@0x55ba7ff31690#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: 2026-02-13T01:20:54.392 INFO:journalctl@ceph.mon.a.trial040.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: starting mon.a rank 0 at public addrs [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] at bind addrs [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mon.a@-1(???) e1 preinit fsid 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mon.a@-1(???).mds e1 new map 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mon.a@-1(???).mds e1 print_map 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout: e1 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout: btime 2026-02-13T01:20:52:557210+0000 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout: legacy client fscid: -1 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout: 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout: No filesystems configured 2026-02-13T01:20:54.393 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: monmap epoch 1 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: fsid 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: last_changed 2026-02-13T01:20:50.888496+0000 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: created 2026-02-13T01:20:50.888496+0000 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: min_mon_release 20 (tentacle) 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: election_strategy: 1 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: 0: [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon.a 2026-02-13T01:20:54.394 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: fsmap 2026-02-13T01:20:54.395 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T01:20:54.395 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:54 trial040 ceph-mon[23046]: mgrmap e1: no daemons active 2026-02-13T01:20:54.677 INFO:teuthology.orchestra.run.trial040.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-13T01:20:54.678 INFO:teuthology.orchestra.run.trial040.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:20:54.678 INFO:teuthology.orchestra.run.trial040.stdout:Creating mgr... 2026-02-13T01:20:54.679 INFO:teuthology.orchestra.run.trial040.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-13T01:20:54.679 INFO:teuthology.orchestra.run.trial040.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-13T01:20:54.917 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.x 2026-02-13T01:20:54.918 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Failed to reset failed state of unit ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.x.service: Unit ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.x.service not loaded. 2026-02-13T01:20:55.103 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-304b456c-087a-11f1-98ea-d404e6e7d460.target.wants/ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-304b456c-087a-11f1-98ea-d404e6e7d460@.service. 2026-02-13T01:20:55.249 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 systemd[1]: Starting Ceph mgr.x for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:20:55.362 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T01:20:55.362 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout disabled 2026-02-13T01:20:55.374 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T01:20:55.374 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout inactive 2026-02-13T01:20:55.374 INFO:teuthology.orchestra.run.trial040.stdout:firewalld.service is not enabled 2026-02-13T01:20:55.374 INFO:teuthology.orchestra.run.trial040.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T01:20:55.389 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T01:20:55.390 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout disabled 2026-02-13T01:20:55.401 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T01:20:55.401 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout inactive 2026-02-13T01:20:55.401 INFO:teuthology.orchestra.run.trial040.stdout:firewalld.service is not enabled 2026-02-13T01:20:55.401 INFO:teuthology.orchestra.run.trial040.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-13T01:20:55.401 INFO:teuthology.orchestra.run.trial040.stdout:Waiting for mgr to start... 2026-02-13T01:20:55.401 INFO:teuthology.orchestra.run.trial040.stdout:Waiting for mgr... 2026-02-13T01:20:55.643 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:55 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2291307136' entity='client.admin' 2026-02-13T01:20:55.644 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 podman[23252]: 2026-02-13 01:20:55.297366048 +0000 UTC m=+0.028357483 container create ad22f5a1eb3d54e940ce4a7f94608ab6c8250d2efea7a897d1e2b70c74a3611e (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x, org.opencontainers.image.licenses=BSD-3-Clause, version=10, OSD_FLAVOR=default, name=rockylinux, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-13T01:20:55.644 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 podman[23252]: 2026-02-13 01:20:55.333865396 +0000 UTC m=+0.064856841 container init ad22f5a1eb3d54e940ce4a7f94608ab6c8250d2efea7a897d1e2b70c74a3611e (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:20:55.644 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 podman[23252]: 2026-02-13 01:20:55.339708482 +0000 UTC m=+0.070699927 container start ad22f5a1eb3d54e940ce4a7f94608ab6c8250d2efea7a897d1e2b70c74a3611e (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, version=10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:20:55.645 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 bash[23252]: ad22f5a1eb3d54e940ce4a7f94608ab6c8250d2efea7a897d1e2b70c74a3611e 2026-02-13T01:20:55.645 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 podman[23252]: 2026-02-13 01:20:55.286458164 +0000 UTC m=+0.017449619 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T01:20:55.645 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 systemd[1]: Started Ceph mgr.x for 304b456c-087a-11f1-98ea-d404e6e7d460. 2026-02-13T01:20:55.645 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.384+0000 7fd9f47b0fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T01:20:55.645 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.442+0000 7fd9f47b0fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:20:55.724 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:55.725 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:20:55.725 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "fsid": "304b456c-087a-11f1-98ea-d404e6e7d460", 2026-02-13T01:20:55.725 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T01:20:55.725 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T01:20:55.725 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T01:20:55.725 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T01:20:55.725 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:55.725 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T01:20:55.725 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 0 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:55.726 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T01:20:55.727 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T01:20:52:557210+0000", 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:55.728 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T01:20:52.557665+0000", 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:20:55.729 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:55.730 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T01:20:55.730 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:20:55.730 INFO:teuthology.orchestra.run.trial040.stdout:mgr not available, waiting (1/15)... 2026-02-13T01:20:55.934 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.796+0000 7fd9f47b0fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.806+0000 7fd9f47b0fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.813+0000 7fd9f47b0fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.820+0000 7fd9f47b0fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.826+0000 7fd9f47b0fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.839+0000 7fd9f47b0fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.865+0000 7fd9f47b0fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.869+0000 7fd9f47b0fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.871+0000 7fd9f47b0fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.878+0000 7fd9f47b0fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:20:55.935 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.933+0000 7fd9f47b0fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:20:56.242 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.935+0000 7fd9f47b0fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:20:56.243 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.940+0000 7fd9f47b0fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:20:56.243 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.942+0000 7fd9f47b0fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:20:56.243 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.943+0000 7fd9f47b0fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:20:56.243 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.947+0000 7fd9f47b0fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:20:56.243 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.948+0000 7fd9f47b0fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:20:56.243 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.951+0000 7fd9f47b0fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:20:56.243 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:55.954+0000 7fd9f47b0fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:20:56.243 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.241+0000 7fd9f47b0fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:20:56.243 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.241+0000 7fd9f47b0fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:20:56.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:56 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3571716064' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T01:20:56.499 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.244+0000 7fd9f47b0fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:20:56.499 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.246+0000 7fd9f47b0fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:20:56.499 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.248+0000 7fd9f47b0fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:20:56.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.249+0000 7fd9f47b0fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:20:56.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.249+0000 7fd9f47b0fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:20:56.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.452+0000 7fd9f47b0fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:20:56.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.484+0000 7fd9f47b0fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:20:56.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.489+0000 7fd9f47b0fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:20:56.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.490+0000 7fd9f47b0fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:20:56.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:56.491+0000 7fd9f47b0fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:20:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: Activating manager daemon x 2026-02-13T01:20:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: mgrmap e2: x(active, starting, since 0.00356739s) 2026-02-13T01:20:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:20:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:20:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:20:57.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:20:57.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:20:57.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: Manager daemon x is now available 2026-02-13T01:20:57.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:20:57.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' 2026-02-13T01:20:57.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' 2026-02-13T01:20:57.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:20:57.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:57 trial040 ceph-mon[23046]: from='mgr.14100 10.20.193.40:0/1700779133' entity='mgr.x' 2026-02-13T01:20:58.140 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "fsid": "304b456c-087a-11f1-98ea-d404e6e7d460", 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T01:20:58.141 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 0 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:20:58.142 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T01:20:58.143 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T01:20:52:557210+0000", 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T01:20:58.144 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T01:20:52.557665+0000", 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T01:20:58.145 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:20:58.146 INFO:teuthology.orchestra.run.trial040.stdout:mgr is available 2026-02-13T01:20:58.502 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:58.502 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T01:20:58.502 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout fsid = 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.40:3300,v1:10.20.193.40:6789] 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T01:20:58.503 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T01:20:58.504 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T01:20:58.504 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T01:20:58.504 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T01:20:58.504 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T01:20:58.504 INFO:teuthology.orchestra.run.trial040.stdout:Enabling cephadm module... 2026-02-13T01:20:58.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:58 trial040 ceph-mon[23046]: mgrmap e3: x(active, since 1.00797s) 2026-02-13T01:20:58.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:58 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1854670864' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T01:20:58.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:58 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2839188245' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T01:20:59.905 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:59 trial040 ceph-mon[23046]: mgrmap e4: x(active, since 2s) 2026-02-13T01:20:59.905 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:20:59 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1808389126' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T01:20:59.905 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: ignoring --setuser ceph since I am not root 2026-02-13T01:20:59.906 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: ignoring --setgroup ceph since I am not root 2026-02-13T01:20:59.906 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:59.575+0000 7f6e62907fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T01:20:59.906 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:59.630+0000 7f6e62907fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:20:59.985 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:20:59.985 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-13T01:20:59.986 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T01:20:59.986 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-13T01:20:59.986 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T01:20:59.986 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:20:59.986 INFO:teuthology.orchestra.run.trial040.stdout:Waiting for the mgr to restart... 2026-02-13T01:20:59.986 INFO:teuthology.orchestra.run.trial040.stdout:Waiting for mgr epoch 5... 2026-02-13T01:21:00.249 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:59.960+0000 7f6e62907fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:21:00.249 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:59.970+0000 7f6e62907fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:21:00.249 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:59.977+0000 7f6e62907fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:59.984+0000 7f6e62907fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:20:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:20:59.990+0000 7f6e62907fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.003+0000 7f6e62907fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.029+0000 7f6e62907fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.033+0000 7f6e62907fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.035+0000 7f6e62907fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.042+0000 7f6e62907fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.099+0000 7f6e62907fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.101+0000 7f6e62907fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.106+0000 7f6e62907fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.108+0000 7f6e62907fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:21:00.250 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.109+0000 7f6e62907fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:21:00.251 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.112+0000 7f6e62907fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:21:00.251 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.114+0000 7f6e62907fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:21:00.251 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.116+0000 7f6e62907fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:21:00.251 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.119+0000 7f6e62907fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:21:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:00 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1808389126' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T01:21:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:00 trial040 ceph-mon[23046]: mgrmap e5: x(active, since 3s) 2026-02-13T01:21:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:00 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1115278534' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T01:21:00.749 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.370+0000 7f6e62907fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.370+0000 7f6e62907fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.372+0000 7f6e62907fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.375+0000 7f6e62907fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.376+0000 7f6e62907fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.377+0000 7f6e62907fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.377+0000 7f6e62907fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.573+0000 7f6e62907fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.604+0000 7f6e62907fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.609+0000 7f6e62907fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.609+0000 7f6e62907fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:21:00.750 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:00.610+0000 7f6e62907fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:21:01.702 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:21:01.702 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-13T01:21:01.702 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T01:21:01.702 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:21:01.702 INFO:teuthology.orchestra.run.trial040.stdout:mgr epoch 5 is available 2026-02-13T01:21:01.702 INFO:teuthology.orchestra.run.trial040.stdout:Verifying orchestrator module is enabled... 2026-02-13T01:21:01.764 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: Active manager daemon x restarted 2026-02-13T01:21:01.764 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: Activating manager daemon x 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: mgrmap e6: x(active, starting, since 0.00279712s) 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: Manager daemon x is now available 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:01.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:01.766 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:01.766 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:01.766 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:01.766 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:01.766 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:01.766 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:01.766 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:01.766 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:21:01.766 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:01 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:21:02.699 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-13T01:21:02.700 INFO:teuthology.orchestra.run.trial040.stdout:Setting orchestrator backend to cephadm... 2026-02-13T01:21:02.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:02 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:02.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:02 trial040 ceph-mon[23046]: mgrmap e7: x(active, since 1.00592s) 2026-02-13T01:21:02.765 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:02 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1990372744' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T01:21:03.432 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-13T01:21:03.432 INFO:teuthology.orchestra.run.trial040.stdout:Generating ssh key... 2026-02-13T01:21:03.728 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:03 trial040 ceph-mon[23046]: Optimize plan auto_2026-02-13_01:21:00, mode upmap, max misplaced 0.050000 2026-02-13T01:21:03.728 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:03 trial040 ceph-mon[23046]: No pools available 2026-02-13T01:21:03.728 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:03 trial040 ceph-mon[23046]: Found migration_current of "None". Setting to last migration. 2026-02-13T01:21:03.728 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:03 trial040 ceph-mon[23046]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T01:21:03.729 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:03 trial040 ceph-mon[23046]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T01:21:03.729 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:03 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1990372744' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T01:21:03.729 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:03 trial040 ceph-mon[23046]: mgrmap e8: x(active, since 2s) 2026-02-13T01:21:03.729 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:03 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:03.729 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:03 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:03.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: Generating public/private ed25519 key pair. 2026-02-13T01:21:03.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: Your identification has been saved in /tmp/tmpk50v_cbr/key 2026-02-13T01:21:03.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: Your public key has been saved in /tmp/tmpk50v_cbr/key.pub 2026-02-13T01:21:03.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: The key fingerprint is: 2026-02-13T01:21:03.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: SHA256:xQ7IQIFYHsvbL1P3UlbJ03qYmFRGs0flbEKl+igBfDE ceph-304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: The key's randomart image is: 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: +--[ED25519 256]--+ 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: | ooo+. E.= ooo| 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: |.o.o o o . * B + | 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: | + o + = * = +| 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: | o B + B o | 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: | . . . S B = . | 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: | o . + . + | 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: | o . . o . . | 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: | o . . | 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: | | 2026-02-13T01:21:04.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: +----[SHA256]-----+ 2026-02-13T01:21:04.195 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKxW4/1Wf7ZSmNFome9NW01eu0TCEz8itNwdApXbmSYl ceph-304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:04.196 INFO:teuthology.orchestra.run.trial040.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:21:04.196 INFO:teuthology.orchestra.run.trial040.stdout:Adding key to root@localhost authorized_keys... 2026-02-13T01:21:04.196 INFO:teuthology.orchestra.run.trial040.stdout:Adding host trial040... 2026-02-13T01:21:04.801 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:04 trial040 ceph-mon[23046]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:04.801 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:04 trial040 ceph-mon[23046]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:04.801 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:04 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:04.801 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:04 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:05.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:05 trial040 ceph-mon[23046]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:05.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:05 trial040 ceph-mon[23046]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:05.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:05 trial040 ceph-mon[23046]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial040", "addr": "10.20.193.40", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:06.875 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout Added host 'trial040' with addr '10.20.193.40' 2026-02-13T01:21:06.875 INFO:teuthology.orchestra.run.trial040.stdout:Deploying unmanaged mon service... 2026-02-13T01:21:07.309 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-13T01:21:07.309 INFO:teuthology.orchestra.run.trial040.stdout:Deploying unmanaged mgr service... 2026-02-13T01:21:07.708 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-13T01:21:07.790 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:07 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:07.791 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:07 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:07.791 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:07 trial040 ceph-mon[23046]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:07.791 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:07 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:07.791 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:07 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:08.114 INFO:teuthology.orchestra.run.trial040.stdout:Saving cluster configuration to /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/config directory 2026-02-13T01:21:08.535 INFO:teuthology.orchestra.run.trial040.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-13T01:21:08.535 INFO:teuthology.orchestra.run.trial040.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout:Or, if you are only running a single cluster on this host: 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:08.536 INFO:teuthology.orchestra.run.trial040.stdout: ceph telemetry on 2026-02-13T01:21:08.537 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:08.537 INFO:teuthology.orchestra.run.trial040.stdout:For more information see: 2026-02-13T01:21:08.537 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:08.537 INFO:teuthology.orchestra.run.trial040.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-13T01:21:08.537 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:08.537 INFO:teuthology.orchestra.run.trial040.stdout:Bootstrap complete. 2026-02-13T01:21:08.553 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout static 2026-02-13T01:21:08.564 INFO:teuthology.orchestra.run.trial040.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-13T01:21:08.564 INFO:teuthology.orchestra.run.trial040.stdout:systemctl: stdout inactive 2026-02-13T01:21:08.565 INFO:teuthology.orchestra.run.trial040.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-13T01:21:08.819 INFO:tasks.cephadm:Fetching config... 2026-02-13T01:21:08.819 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:21:08.819 DEBUG:teuthology.orchestra.run.trial040:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-13T01:21:08.858 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-13T01:21:08.858 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:21:08.859 DEBUG:teuthology.orchestra.run.trial040:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-13T01:21:08.937 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-13T01:21:08.937 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:21:08.937 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-13T01:21:09.036 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-13T01:21:09.036 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:21:09.037 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-13T01:21:09.114 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-13T01:21:09.114 DEBUG:teuthology.orchestra.run.trial040:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKxW4/1Wf7ZSmNFome9NW01eu0TCEz8itNwdApXbmSYl ceph-304b456c-087a-11f1-98ea-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T01:21:09.203 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:08 trial040 ceph-mon[23046]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:09.203 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:08 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:09.204 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:08 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2377567937' entity='client.admin' 2026-02-13T01:21:09.204 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:08 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:09.204 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:08 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/517240812' entity='client.admin' 2026-02-13T01:21:09.227 INFO:teuthology.orchestra.run.trial040.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKxW4/1Wf7ZSmNFome9NW01eu0TCEz8itNwdApXbmSYl ceph-304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:09.249 DEBUG:teuthology.orchestra.run.trial055:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKxW4/1Wf7ZSmNFome9NW01eu0TCEz8itNwdApXbmSYl ceph-304b456c-087a-11f1-98ea-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T01:21:09.288 INFO:teuthology.orchestra.run.trial055.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKxW4/1Wf7ZSmNFome9NW01eu0TCEz8itNwdApXbmSYl ceph-304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:09.298 DEBUG:teuthology.orchestra.run.trial118:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKxW4/1Wf7ZSmNFome9NW01eu0TCEz8itNwdApXbmSYl ceph-304b456c-087a-11f1-98ea-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T01:21:09.335 INFO:teuthology.orchestra.run.trial118.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKxW4/1Wf7ZSmNFome9NW01eu0TCEz8itNwdApXbmSYl ceph-304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:09.346 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-13T01:21:09.535 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:09.944 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-13T01:21:09.944 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-13T01:21:10.133 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:10.466 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:10 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:10.466 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:10 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1387952766' entity='client.admin' 2026-02-13T01:21:10.592 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial055 2026-02-13T01:21:10.592 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:21:10.592 DEBUG:teuthology.orchestra.run.trial055:> dd of=/etc/ceph/ceph.conf 2026-02-13T01:21:10.610 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:21:10.610 DEBUG:teuthology.orchestra.run.trial055:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:21:10.666 INFO:tasks.cephadm:Adding host trial055 to orchestrator... 2026-02-13T01:21:10.666 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch host add trial055 2026-02-13T01:21:10.855 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:11.646 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:11 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:11.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:11 trial040 ceph-mon[23046]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:11.647 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:11 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:12.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:12 trial040 ceph-mon[23046]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial055", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:12.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:12 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:12.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:12 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:12.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:12 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:12.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:12 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:12.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:12 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial040", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:12.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:12 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:12.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:12 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:13.023 INFO:teuthology.orchestra.run.trial040.stdout:Added host 'trial055' with addr '10.20.193.55' 2026-02-13T01:21:13.134 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T01:21:13.323 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:13.637 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:13.638 INFO:teuthology.orchestra.run.trial040.stdout:[{"addr": "10.20.193.40", "hostname": "trial040", "labels": [], "status": ""}, {"addr": "10.20.193.55", "hostname": "trial055", "labels": [], "status": ""}] 2026-02-13T01:21:13.773 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial118 2026-02-13T01:21:13.774 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:21:13.774 DEBUG:teuthology.orchestra.run.trial118:> dd of=/etc/ceph/ceph.conf 2026-02-13T01:21:13.793 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:21:13.793 DEBUG:teuthology.orchestra.run.trial118:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:21:13.849 INFO:tasks.cephadm:Adding host trial118 to orchestrator... 2026-02-13T01:21:13.850 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch host add trial118 2026-02-13T01:21:14.034 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:14.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:14 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:14.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:14 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:14.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:14 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:14.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:14 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:14.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:14 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:14.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:14 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:15.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:15 trial040 ceph-mon[23046]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:21:15.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:15 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:15.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:15 trial040 ceph-mon[23046]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial118", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:15.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:15 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.171 INFO:teuthology.orchestra.run.trial040.stdout:Added host 'trial118' with addr '10.20.193.118' 2026-02-13T01:21:16.277 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T01:21:16.461 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:16.768 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.768 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.768 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial055", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:16.769 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:16 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:16.770 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:16.770 INFO:teuthology.orchestra.run.trial040.stdout:[{"addr": "10.20.193.40", "hostname": "trial040", "labels": [], "status": ""}, {"addr": "10.20.193.55", "hostname": "trial055", "labels": [], "status": ""}, {"addr": "10.20.193.118", "hostname": "trial118", "labels": [], "status": ""}] 2026-02-13T01:21:16.869 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-13T01:21:16.869 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd crush tunables default 2026-02-13T01:21:17.054 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:17.850 INFO:teuthology.orchestra.run.trial040.stderr:adjusted tunables profile to default 2026-02-13T01:21:17.955 INFO:tasks.cephadm:Adding mon.a on trial040 2026-02-13T01:21:17.955 INFO:tasks.cephadm:Adding mon.b on trial055 2026-02-13T01:21:17.955 INFO:tasks.cephadm:Adding mon.c on trial118 2026-02-13T01:21:17.956 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch apply mon '3;trial040:10.20.193.40=a;trial055:10.20.193.55=b;trial118:10.20.193.118=c' 2026-02-13T01:21:18.086 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:21:18.087 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:21:18.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:17 trial040 ceph-mon[23046]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:21:18.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:17 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:18.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:17 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2192048503' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T01:21:18.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:17 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:18.312 INFO:teuthology.orchestra.run.trial118.stdout:Scheduled mon update... 2026-02-13T01:21:18.353 DEBUG:teuthology.orchestra.run.trial055:mon.b> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.b.service 2026-02-13T01:21:18.356 DEBUG:teuthology.orchestra.run.trial118:mon.c> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.c.service 2026-02-13T01:21:18.359 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T01:21:18.359 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T01:21:18.615 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:21:18.615 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:21:18.883 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:21:18.883 INFO:teuthology.orchestra.run.trial118.stdout:{"epoch":1,"fsid":"304b456c-087a-11f1-98ea-d404e6e7d460","modified":"2026-02-13T01:20:50.888496Z","created":"2026-02-13T01:20:50.888496Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:3300","nonce":0},{"type":"v1","addr":"10.20.193.40:6789","nonce":0}]},"addr":"10.20.193.40:6789/0","public_addr":"10.20.193.40:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:20:50:888519+0000","crush_location":[]}],"quorum":[0]} 2026-02-13T01:21:18.884 INFO:teuthology.orchestra.run.trial118.stderr:dumped monmap epoch 1 2026-02-13T01:21:19.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2192048503' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T01:21:19.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:21:19.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial040:10.20.193.40=a;trial055:10.20.193.55=b;trial118:10.20.193.118=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:19.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:19.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:19.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:19.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:19.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:19.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial118", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:19.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:19.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:18 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:19.952 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T01:21:19.953 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T01:21:20.181 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:21:20.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:19 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/2335455481' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:21:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:19 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:19 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:19 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:19 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:19 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: mon.a calling monitor election 2026-02-13T01:21:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:21:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: mon.c calling monitor election 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: monmap epoch 2 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: fsid 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: last_changed 2026-02-13T01:21:20.268905+0000 2026-02-13T01:21:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: created 2026-02-13T01:20:50.888496+0000 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: min_mon_release 20 (tentacle) 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: election_strategy: 1 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: 0: [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon.a 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: 1: [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] mon.c 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: fsmap 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: mgrmap e8: x(active, since 24s) 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: overall HEALTH_OK 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:25.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:25.752 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:25 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:25.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:25 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:26.430 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:21:26.430 INFO:teuthology.orchestra.run.trial118.stdout:{"epoch":2,"fsid":"304b456c-087a-11f1-98ea-d404e6e7d460","modified":"2026-02-13T01:21:20.268905Z","created":"2026-02-13T01:20:50.888496Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:3300","nonce":0},{"type":"v1","addr":"10.20.193.40:6789","nonce":0}]},"addr":"10.20.193.40:6789/0","public_addr":"10.20.193.40:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:20:50:888519+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:3300","nonce":0},{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:21:20:268904+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-13T01:21:26.431 INFO:teuthology.orchestra.run.trial118.stderr:dumped monmap epoch 2 2026-02-13T01:21:26.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:26 trial055 ceph-mon[27509]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T01:21:26.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:26 trial040 ceph-mon[23046]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:26.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:26 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:26.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:26 trial118 ceph-mon[27812]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:26.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:26 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:27.489 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T01:21:27.489 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T01:21:27.609 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:21:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:21:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: mon.a calling monitor election 2026-02-13T01:21:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: mon.c calling monitor election 2026-02-13T01:21:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: mon.b calling monitor election 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: monmap epoch 3 2026-02-13T01:21:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: fsid 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: last_changed 2026-02-13T01:21:26.600950+0000 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: created 2026-02-13T01:20:50.888496+0000 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: min_mon_release 20 (tentacle) 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: election_strategy: 1 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: 0: [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon.a 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: 1: [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] mon.c 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: 2: [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] mon.b 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: fsmap 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: mgrmap e8: x(active, since 30s) 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: overall HEALTH_OK 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:31.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:31.995 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:31.995 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:31 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:21:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: mon.a calling monitor election 2026-02-13T01:21:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: mon.c calling monitor election 2026-02-13T01:21:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: mon.b calling monitor election 2026-02-13T01:21:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: monmap epoch 3 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: fsid 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: last_changed 2026-02-13T01:21:26.600950+0000 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: created 2026-02-13T01:20:50.888496+0000 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: min_mon_release 20 (tentacle) 2026-02-13T01:21:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: election_strategy: 1 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: 0: [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon.a 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: 1: [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] mon.c 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: 2: [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] mon.b 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: fsmap 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: mgrmap e8: x(active, since 30s) 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: overall HEALTH_OK 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:31 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:21:32.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:32.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: mon.a calling monitor election 2026-02-13T01:21:32.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: mon.c calling monitor election 2026-02-13T01:21:32.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: mon.b calling monitor election 2026-02-13T01:21:32.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:32.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: monmap epoch 3 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: fsid 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: last_changed 2026-02-13T01:21:26.600950+0000 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: created 2026-02-13T01:20:50.888496+0000 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: min_mon_release 20 (tentacle) 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: election_strategy: 1 2026-02-13T01:21:32.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: 0: [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon.a 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: 1: [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] mon.c 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: 2: [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] mon.b 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: fsmap 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: mgrmap e8: x(active, since 30s) 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: overall HEALTH_OK 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:31 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.264 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:21:32.264 INFO:teuthology.orchestra.run.trial118.stdout:{"epoch":3,"fsid":"304b456c-087a-11f1-98ea-d404e6e7d460","modified":"2026-02-13T01:21:26.600950Z","created":"2026-02-13T01:20:50.888496Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:3300","nonce":0},{"type":"v1","addr":"10.20.193.40:6789","nonce":0}]},"addr":"10.20.193.40:6789/0","public_addr":"10.20.193.40:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:20:50:888519+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:3300","nonce":0},{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:21:20:268904+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:3300","nonce":0},{"type":"v1","addr":"10.20.193.55:6789","nonce":0}]},"addr":"10.20.193.55:6789/0","public_addr":"10.20.193.55:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:21:26:600948+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-13T01:21:32.265 INFO:teuthology.orchestra.run.trial118.stderr:dumped monmap epoch 3 2026-02-13T01:21:32.305 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-13T01:21:32.305 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-13T01:21:32.492 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:32.800 INFO:teuthology.orchestra.run.trial040.stdout:# minimal ceph.conf for 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:32.800 INFO:teuthology.orchestra.run.trial040.stdout:[global] 2026-02-13T01:21:32.800 INFO:teuthology.orchestra.run.trial040.stdout: fsid = 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:21:32.800 INFO:teuthology.orchestra.run.trial040.stdout: mon_host = [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/3005196117' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:32 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:32.908 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-13T01:21:32.909 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:21:32.909 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T01:21:32.968 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:21:32.968 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:21:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='client.? 10.20.193.118:0/3005196117' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:21:32.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:32.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:32 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='client.? 10.20.193.118:0/3005196117' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:32 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:33.067 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:21:33.067 DEBUG:teuthology.orchestra.run.trial055:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T01:21:33.095 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:21:33.095 DEBUG:teuthology.orchestra.run.trial055:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:21:33.159 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:21:33.160 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T01:21:33.188 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:21:33.188 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:21:33.252 INFO:tasks.cephadm:enabling module snap_schedule 2026-02-13T01:21:33.253 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2026-02-13T01:21:33.442 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:33.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:33.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/762592442' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:33.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:33.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:21:33.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:33.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:33.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:21:33.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:33 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:33.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:33.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:33.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/762592442' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:33.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:34.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:21:34.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:34.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:21:34.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:33 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.000 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:33 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:33.601+0000 7f6e0ca9d6c0 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-13T01:21:34.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:34.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/762592442' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:34.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:21:34.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:34.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:21:34.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:33 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.841 INFO:tasks.cephadm:Adding mgr.x on trial040 2026-02-13T01:21:34.841 INFO:tasks.cephadm:Adding mgr.y on trial055 2026-02-13T01:21:34.841 INFO:tasks.cephadm:Adding mgr.z on trial118 2026-02-13T01:21:34.842 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch apply mgr '3;trial040=x;trial055=y;trial118=z' 2026-02-13T01:21:34.958 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:21:34.981 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1819067712' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T01:21:34.981 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.981 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.981 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:34.981 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:21:34.981 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.981 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.981 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.981 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:34.982 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.982 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:34.982 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:34 trial118 ceph-mon[27812]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1819067712' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:34 trial055 ceph-mon[27509]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1819067712' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T01:21:34.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:34 trial040 ceph-mon[23046]: from='mgr.14116 10.20.193.40:0/1034934212' entity='mgr.x' 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:34 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: ignoring --setuser ceph since I am not root 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:34 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: ignoring --setgroup ceph since I am not root 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:34 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:34.827+0000 7f3064f15fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T01:21:34.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:34 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:34.882+0000 7f3064f15fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:21:35.499 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.206+0000 7f3064f15fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:21:35.499 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.216+0000 7f3064f15fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:21:35.499 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.222+0000 7f3064f15fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:21:35.499 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.229+0000 7f3064f15fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.235+0000 7f3064f15fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.248+0000 7f3064f15fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.274+0000 7f3064f15fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.277+0000 7f3064f15fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.279+0000 7f3064f15fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.286+0000 7f3064f15fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.337+0000 7f3064f15fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.339+0000 7f3064f15fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.343+0000 7f3064f15fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.346+0000 7f3064f15fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:21:35.500 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.346+0000 7f3064f15fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:21:35.501 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.350+0000 7f3064f15fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:21:35.501 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.351+0000 7f3064f15fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:21:35.501 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.354+0000 7f3064f15fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:21:35.501 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.357+0000 7f3064f15fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:21:35.879 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:35 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1819067712' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T01:21:35.880 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:35 trial040 ceph-mon[23046]: mgrmap e9: x(active, since 34s) 2026-02-13T01:21:35.880 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.613+0000 7f3064f15fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:21:35.880 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.613+0000 7f3064f15fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:21:35.880 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.615+0000 7f3064f15fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:21:35.880 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.618+0000 7f3064f15fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:21:35.880 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.619+0000 7f3064f15fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:21:35.880 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.620+0000 7f3064f15fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:21:35.880 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.620+0000 7f3064f15fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:21:35.881 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.816+0000 7f3064f15fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:21:35.881 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.847+0000 7f3064f15fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:21:35.881 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.851+0000 7f3064f15fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:21:35.881 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.852+0000 7f3064f15fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:21:35.881 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:21:35.853+0000 7f3064f15fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:21:35.881 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:345: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-13T01:21:35.881 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: tz = given_cert.not_valid_after.tzinfo 2026-02-13T01:21:35.881 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:346: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-13T01:21:35.881 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:21:35 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: if datetime.now(tz) >= given_cert.not_valid_after: 2026-02-13T01:21:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:35 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1819067712' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T01:21:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:35 trial055 ceph-mon[27509]: mgrmap e9: x(active, since 34s) 2026-02-13T01:21:36.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:35 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1819067712' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T01:21:36.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:35 trial118 ceph-mon[27812]: mgrmap e9: x(active, since 34s) 2026-02-13T01:21:36.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: Active manager daemon x restarted 2026-02-13T01:21:36.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: Activating manager daemon x 2026-02-13T01:21:36.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T01:21:36.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: mgrmap e10: x(active, starting, since 0.00313236s) 2026-02-13T01:21:36.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: Manager daemon x is now available 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:21:36.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: Active manager daemon x restarted 2026-02-13T01:21:36.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: Activating manager daemon x 2026-02-13T01:21:36.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T01:21:36.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: mgrmap e10: x(active, starting, since 0.00313236s) 2026-02-13T01:21:36.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:21:36.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:36.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: Manager daemon x is now available 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.869 INFO:teuthology.orchestra.run.trial118.stdout:Scheduled mgr update... 2026-02-13T01:21:36.912 DEBUG:teuthology.orchestra.run.trial055:mgr.y> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.y.service 2026-02-13T01:21:36.914 DEBUG:teuthology.orchestra.run.trial118:mgr.z> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.z.service 2026-02-13T01:21:36.917 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-13T01:21:36.917 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-13T01:21:36.921 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-13T01:21:36.922 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-13T01:21:36.966 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-13T01:21:36.966 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-13T01:21:36.969 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: Active manager daemon x restarted 2026-02-13T01:21:36.970 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: Activating manager daemon x 2026-02-13T01:21:36.970 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T01:21:36.970 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: mgrmap e10: x(active, starting, since 0.00313236s) 2026-02-13T01:21:36.970 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:21:36.970 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:21:36.970 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:21:36.970 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:21:36.970 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: Manager daemon x is now available 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.971 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:36.973 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-13T01:21:36.973 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-13T01:21:37.018 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-13T01:21:37.019 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-13T01:21:37.085 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-13T01:21:37.085 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-13T01:21:37.115 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.117 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-13T01:21:37.117 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-13T01:21:37.150 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.156 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-13T01:21:37.157 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-13T01:21:37.172 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.178 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-13T01:21:37.178 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-13T01:21:37.226 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-13T01:21:37.226 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-13T01:21:37.255 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.259 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-13T01:21:37.259 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-13T01:21:37.314 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-13T01:21:37.314 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-13T01:21:37.335 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.339 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-13T01:21:37.339 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-13T01:21:37.387 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-13T01:21:37.387 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-13T01:21:37.408 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.412 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-13T01:21:37.412 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-13T01:21:37.479 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-13T01:21:37.480 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-13T01:21:37.528 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-13T01:21:37.528 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-13T01:21:37.575 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T01:21:37.575 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-13T01:21:37.576 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.639 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T01:21:37.639 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-13T01:21:37.684 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.684 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.736 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-13T01:21:37.737 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-13T01:21:37.738 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.730+0000 7fc874ff96c0 1 -- 10.20.193.40:0/1583965096 <== mon.2 v2:10.20.193.55:3300/0 9 ==== config(28 keys) ==== 1157+0+0 (secure 0 0 0) 0x7fc860007540 con 0x7fc878113dc0 2026-02-13T01:21:37.738 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.730+0000 7fc874ff96c0 1 -- 10.20.193.40:0/1583965096 <== mon.2 v2:10.20.193.55:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7fc860010860 con 0x7fc878113dc0 2026-02-13T01:21:37.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 -- 10.20.193.40:0/2552884322 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6f4003f820 msgr2=0x7f6f4005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 --2- 10.20.193.40:0/2552884322 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6f4003f820 0x7f6f4005fcd0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f5c005830 tx=0x7f6f5c00a310 comp rx=0 tx=0).stop 2026-02-13T01:21:37.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 -- 10.20.193.40:0/2552884322 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6f6c05d690 msgr2=0x7f6f6c155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 --2- 10.20.193.40:0/2552884322 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6f6c05d690 0x7f6f6c155030 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f54009490 tx=0x7f6f5400bca0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 -- 10.20.193.40:0/2552884322 shutdown_connections 2026-02-13T01:21:37.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 --2- 10.20.193.40:0/2552884322 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6f4003f820 0x7f6f4005fcd0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 --2- 10.20.193.40:0/2552884322 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6f6c155790 0x7f6f6c101cf0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 --2- 10.20.193.40:0/2552884322 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6f6c134c50 0x7f6f6c175b70 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 --2- 10.20.193.40:0/2552884322 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6f6c05d690 0x7f6f6c155030 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 -- 10.20.193.40:0/2552884322 >> 10.20.193.40:0/2552884322 conn(0x7f6f6c05b720 msgr2=0x7f6f6c0f6290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:37.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 -- 10.20.193.40:0/2552884322 shutdown_connections 2026-02-13T01:21:37.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.729+0000 7f6f70ffb6c0 1 -- 10.20.193.40:0/2552884322 wait complete. 2026-02-13T01:21:37.740 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.741 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.735+0000 7fc87cc406c0 1 -- 10.20.193.40:0/1583965096 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc84c03f820 msgr2=0x7fc84c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.735+0000 7fc87cc406c0 1 --2- 10.20.193.40:0/1583965096 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc84c03f820 0x7fc84c05fcd0 secure :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc870005830 tx=0x7fc870006f50 comp rx=0 tx=0).stop 2026-02-13T01:21:37.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.735+0000 7fc87cc406c0 1 -- 10.20.193.40:0/1583965096 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc878113dc0 msgr2=0x7fc878154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.735+0000 7fc87cc406c0 1 --2- 10.20.193.40:0/1583965096 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc878113dc0 0x7fc878154c00 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc86000b6c0 tx=0x7fc86000bb90 comp rx=0 tx=0).stop 2026-02-13T01:21:37.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.736+0000 7fc87cc406c0 1 -- 10.20.193.40:0/1583965096 shutdown_connections 2026-02-13T01:21:37.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.736+0000 7fc87cc406c0 1 --2- 10.20.193.40:0/1583965096 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc84c03f820 0x7fc84c05fcd0 unknown :-1 s=CLOSED pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.736+0000 7fc87cc406c0 1 --2- 10.20.193.40:0/1583965096 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc878155340 0x7fc87811c830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.736+0000 7fc87cc406c0 1 --2- 10.20.193.40:0/1583965096 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8781347c0 0x7fc878175770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.736+0000 7fc87cc406c0 1 --2- 10.20.193.40:0/1583965096 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc878113dc0 0x7fc878154c00 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.736+0000 7fc87cc406c0 1 -- 10.20.193.40:0/1583965096 >> 10.20.193.40:0/1583965096 conn(0x7fc87805b720 msgr2=0x7fc87817bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:37.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.736+0000 7fc87cc406c0 1 -- 10.20.193.40:0/1583965096 shutdown_connections 2026-02-13T01:21:37.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.736+0000 7fc87cc406c0 1 -- 10.20.193.40:0/1583965096 wait complete. 2026-02-13T01:21:37.783 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2026-02-13T01:21:37.783 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr debug_cephsqlite 20 2026-02-13T01:21:37.784 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:37.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.793+0000 7fdb929e36c0 1 -- 10.20.193.40:0/1399932388 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdb8c155330 msgr2=0x7fdb8c1757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.793+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/1399932388 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdb8c155330 0x7fdb8c1757e0 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=13534713634845936039 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb88006fd0 tx=0x7fdb88032030 comp rx=0 tx=0).stop 2026-02-13T01:21:37.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.793+0000 7fdb929e36c0 1 -- 10.20.193.40:0/1399932388 shutdown_connections 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.793+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/1399932388 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdb8c155330 0x7fdb8c1757e0 unknown :-1 s=CLOSED pgs=7 gs=3 cs=0 l=1 c_cookie=13534713634845936039 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.793+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/1399932388 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdb8c134770 0x7fdb8c154bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.793+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/1399932388 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdb8c113dc0 0x7fdb8c1341a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.793+0000 7fdb929e36c0 1 -- 10.20.193.40:0/1399932388 >> 10.20.193.40:0/1399932388 conn(0x7fdb8c05bb70 msgr2=0x7fdb8c05bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.794+0000 7fdb929e36c0 1 -- 10.20.193.40:0/1399932388 shutdown_connections 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.794+0000 7fdb929e36c0 1 -- 10.20.193.40:0/1399932388 wait complete. 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.795+0000 7fdb929e36c0 1 Processor -- start 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.795+0000 7fdb929e36c0 1 -- start start 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.795+0000 7fdb929e36c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdb8c113dc0 0x7fdb8c154bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.795+0000 7fdb929e36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdb8c134770 0x7fdb8c175760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.795+0000 7fdb929e36c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdb8c155330 0x7fdb8c108250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.795+0000 7fdb929e36c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c1089e0 con 0x7fdb8c134770 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.795+0000 7fdb929e36c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c108b50 con 0x7fdb8c113dc0 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.795+0000 7fdb929e36c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c1091e0 con 0x7fdb8c155330 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.796+0000 7fdb919e16c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdb8c113dc0 0x7fdb8c154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.796+0000 7fdb919e16c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdb8c113dc0 0x7fdb8c154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43312/0 (socket says 10.20.193.40:43312) 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.796+0000 7fdb919e16c0 1 -- 10.20.193.40:0/3237391207 learned_addr learned my addr 10.20.193.40:0/3237391207 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.796+0000 7fdb911e06c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdb8c134770 0x7fdb8c175760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.796+0000 7fdb919e16c0 1 -- 10.20.193.40:0/3237391207 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdb8c155330 msgr2=0x7fdb8c108250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.796+0000 7fdb919e16c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdb8c155330 0x7fdb8c108250 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.796+0000 7fdb919e16c0 1 -- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdb8c134770 msgr2=0x7fdb8c175760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.796+0000 7fdb919e16c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdb8c134770 0x7fdb8c175760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.796+0000 7fdb919e16c0 1 -- 10.20.193.40:0/3237391207 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8800a5b0 con 0x7fdb8c113dc0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.797+0000 7fdb919e16c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdb8c113dc0 0x7fdb8c154bf0 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb7c00b800 tx=0x7fdb7c00bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.797+0000 7fdb7affd6c0 1 -- 10.20.193.40:0/3237391207 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb7c004a80 con 0x7fdb8c113dc0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.797+0000 7fdb7affd6c0 1 -- 10.20.193.40:0/3237391207 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(28 keys) ==== 1157+0+0 (secure 0 0 0) 0x7fdb7c009030 con 0x7fdb8c113dc0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.797+0000 7fdb7affd6c0 1 -- 10.20.193.40:0/3237391207 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb7c0071c0 con 0x7fdb8c113dc0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.797+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8c1094c0 con 0x7fdb8c113dc0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.798+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb8c109920 con 0x7fdb8c113dc0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.799+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c005100 con 0x7fdb8c113dc0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.799+0000 7fdb7affd6c0 1 -- 10.20.193.40:0/3237391207 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fdb7c004e90 con 0x7fdb8c113dc0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.800+0000 7fdb7affd6c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdb6003f7a0 0x7fdb6005fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.800+0000 7fdb7affd6c0 1 -- 10.20.193.40:0/3237391207 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fdb7c051220 con 0x7fdb8c113dc0 2026-02-13T01:21:37.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.800+0000 7fdb911e06c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdb6003f7a0 0x7fdb6005fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.801+0000 7fdb911e06c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdb6003f7a0 0x7fdb6005fc50 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb80004750 tx=0x7fdb80009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:37.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.803+0000 7fdb7affd6c0 1 -- 10.20.193.40:0/3237391207 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdb7c008030 con 0x7fdb8c113dc0 2026-02-13T01:21:37.823 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-13T01:21:37.824 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-13T01:21:37.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.857+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/3157882094 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcbc805e760 msgr2=0x7fcbc8113dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.857+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/3157882094 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcbc805e760 0x7fcbc8113dc0 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=9194196847323812564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbb00098a0 tx=0x7fcbb002ec60 comp rx=0 tx=0).stop 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.857+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/3157882094 shutdown_connections 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.857+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/3157882094 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcbc8114f40 0x7fcbc81153c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.857+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/3157882094 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcbc81143e0 0x7fcbc8114850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.857+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/3157882094 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcbc805e760 0x7fcbc8113dc0 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=9194196847323812564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.857+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/3157882094 >> 10.20.193.40:0/3157882094 conn(0x7fcbc805b720 msgr2=0x7fcbc805bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.858+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/3157882094 shutdown_connections 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.858+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/3157882094 wait complete. 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.859+0000 7fcbcdec36c0 1 Processor -- start 2026-02-13T01:21:37.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.859+0000 7fcbcdec36c0 1 -- start start 2026-02-13T01:21:37.868 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-13T01:21:37.868 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbcdec36c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcbc805e760 0x7fcbc81b4680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbcdec36c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcbc81143e0 0x7fcbc81b4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbcdec36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcbc8114f40 0x7fcbc81b58c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbccec16c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcbc805e760 0x7fcbc81b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbccec16c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcbc805e760 0x7fcbc81b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:45818/0 (socket says 10.20.193.40:45818) 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbc7fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcbc81143e0 0x7fcbc81b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbc7fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcbc81143e0 0x7fcbc81b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43328/0 (socket says 10.20.193.40:43328) 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbcdec36c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc81b6050 con 0x7fcbc8114f40 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbcdec36c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc81b61c0 con 0x7fcbc81143e0 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.860+0000 7fcbcdec36c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc81b6380 con 0x7fcbc805e760 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.861+0000 7fcbccec16c0 1 -- 10.20.193.40:0/146834022 learned_addr learned my addr 10.20.193.40:0/146834022 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.861+0000 7fcbccec16c0 1 -- 10.20.193.40:0/146834022 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcbc81143e0 msgr2=0x7fcbc81b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.861+0000 7fcbccec16c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcbc81143e0 0x7fcbc81b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.861+0000 7fcbccec16c0 1 -- 10.20.193.40:0/146834022 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcbc8114f40 msgr2=0x7fcbc81b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.861+0000 7fcbccec16c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcbc8114f40 0x7fcbc81b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.861+0000 7fcbccec16c0 1 -- 10.20.193.40:0/146834022 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc009590 con 0x7fcbc805e760 2026-02-13T01:21:37.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.862+0000 7fcbccec16c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcbc805e760 0x7fcbc81b4680 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbb00099d0 tx=0x7fcbb0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:37.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.863+0000 7fcbc5ffb6c0 1 -- 10.20.193.40:0/146834022 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcbb00029d0 con 0x7fcbc805e760 2026-02-13T01:21:37.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.872+0000 7fcbc5ffb6c0 1 -- 10.20.193.40:0/146834022 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(28 keys) ==== 1157+0+0 (secure 0 0 0) 0x7fcbb0002b30 con 0x7fcbc805e760 2026-02-13T01:21:37.881 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-13T01:21:37.881 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-13T01:21:37.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.872+0000 7fcbc5ffb6c0 1 -- 10.20.193.40:0/146834022 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcbb0007490 con 0x7fcbc805e760 2026-02-13T01:21:37.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.872+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb00094c0 con 0x7fcbc805e760 2026-02-13T01:21:37.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.872+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc81b6740 con 0x7fcbc805e760 2026-02-13T01:21:37.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.874+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc81196a0 con 0x7fcbc805e760 2026-02-13T01:21:37.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.875+0000 7fcbc5ffb6c0 1 -- 10.20.193.40:0/146834022 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fcbb0002ca0 con 0x7fcbc805e760 2026-02-13T01:21:37.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.886+0000 7fcbc5ffb6c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb9c03f870 0x7fcb9c05fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.893 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2026-02-13T01:21:37.893 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2026-02-13T01:21:37.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.887+0000 7fcbc5ffb6c0 1 -- 10.20.193.40:0/146834022 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fcbb00754c0 con 0x7fcbc805e760 2026-02-13T01:21:37.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.887+0000 7fcbc7fff6c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb9c03f870 0x7fcb9c05fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.889+0000 7fcbc7fff6c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb9c03f870 0x7fcb9c05fd20 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbbc005b40 tx=0x7fcbbc009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:37.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.890+0000 7fcbc5ffb6c0 1 -- 10.20.193.40:0/146834022 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcbb0077a30 con 0x7fcbc805e760 2026-02-13T01:21:37.922 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.921+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fdb5c0053b0 con 0x7fdb8c113dc0 2026-02-13T01:21:37.956 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2026-02-13T01:21:37.956 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2026-02-13T01:21:37.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.928+0000 7fdb7affd6c0 1 -- 10.20.193.40:0/3237391207 <== mon.2 v2:10.20.193.55:3300/0 7 ==== config(29 keys) ==== 1188+0+0 (secure 0 0 0) 0x7fdb7c008030 con 0x7fdb8c113dc0 2026-02-13T01:21:37.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.929+0000 7fdb7affd6c0 1 -- 10.20.193.40:0/3237391207 <== mon.2 v2:10.20.193.55:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fdb7c010880 con 0x7fdb8c113dc0 2026-02-13T01:21:37.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdb6003f7a0 msgr2=0x7fdb6005fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdb6003f7a0 0x7fdb6005fc50 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb80004750 tx=0x7fdb80009260 comp rx=0 tx=0).stop 2026-02-13T01:21:37.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdb8c113dc0 msgr2=0x7fdb8c154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdb8c113dc0 0x7fdb8c154bf0 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb7c00b800 tx=0x7fdb7c00bcd0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 shutdown_connections 2026-02-13T01:21:37.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdb6003f7a0 0x7fdb6005fc50 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdb8c155330 0x7fdb8c108250 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdb8c134770 0x7fdb8c175760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 --2- 10.20.193.40:0/3237391207 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdb8c113dc0 0x7fdb8c154bf0 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.934+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 >> 10.20.193.40:0/3237391207 conn(0x7fdb8c05bb70 msgr2=0x7fdb8c0f4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:37.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.935+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 shutdown_connections 2026-02-13T01:21:37.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.935+0000 7fdb929e36c0 1 -- 10.20.193.40:0/3237391207 wait complete. 2026-02-13T01:21:37.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.928+0000 7fcbc5ffb6c0 1 -- 10.20.193.40:0/146834022 <== mon.1 v2:10.20.193.118:3300/0 7 ==== config(29 keys) ==== 1188+0+0 (secure 0 0 0) 0x7fcbb00079d0 con 0x7fcbc805e760 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.949+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/98781105 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc1347c0 msgr2=0x7f5dcc154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.949+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/98781105 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc1347c0 0x7f5dcc154c00 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=17525281453757360422 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5db80098a0 tx=0x7f5db802ec40 comp rx=0 tx=0).stop 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.949+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/98781105 shutdown_connections 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.949+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/98781105 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5dcc155340 0x7f5dcc1757f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.949+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/98781105 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc1347c0 0x7f5dcc154c00 unknown :-1 s=CLOSED pgs=9 gs=2 cs=0 l=1 c_cookie=17525281453757360422 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.949+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/98781105 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5dcc113dc0 0x7f5dcc1341a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.949+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/98781105 >> 10.20.193.40:0/98781105 conn(0x7f5dcc05b720 msgr2=0x7f5dcc05bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.949+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/98781105 shutdown_connections 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.949+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/98781105 wait complete. 2026-02-13T01:21:37.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.950+0000 7f5dd1b376c0 1 Processor -- start 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.950+0000 7f5dd1b376c0 1 -- start start 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.951+0000 7f5dd1b376c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5dcc113dc0 0x7f5dcc154ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.951+0000 7f5dd1b376c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5dcc1347c0 0x7f5dcc10d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.951+0000 7f5dd1b376c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc155340 0x7f5dcc10e000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.951+0000 7f5dd1b376c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc10ebf0 con 0x7f5dcc113dc0 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.952+0000 7f5dd1b376c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc10ed60 con 0x7f5dcc155340 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.952+0000 7f5dd1b376c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc10ef20 con 0x7f5dcc1347c0 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.952+0000 7f5dd13366c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc155340 0x7f5dcc10e000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.952+0000 7f5dd13366c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc155340 0x7f5dcc10e000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43346/0 (socket says 10.20.193.40:43346) 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.952+0000 7f5dd13366c0 1 -- 10.20.193.40:0/866489127 learned_addr learned my addr 10.20.193.40:0/866489127 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.952+0000 7f5dc3fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5dcc1347c0 0x7f5dcc10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.953+0000 7f5dd0b356c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5dcc113dc0 0x7f5dcc154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.953+0000 7f5dd13366c0 1 -- 10.20.193.40:0/866489127 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5dcc1347c0 msgr2=0x7f5dcc10d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.953+0000 7f5dd13366c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5dcc1347c0 0x7f5dcc10d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.953+0000 7f5dd13366c0 1 -- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5dcc113dc0 msgr2=0x7f5dcc154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.953+0000 7f5dd13366c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5dcc113dc0 0x7f5dcc154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.953+0000 7f5dd13366c0 1 -- 10.20.193.40:0/866489127 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db80094c0 con 0x7f5dcc155340 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.953+0000 7f5dd0b356c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5dcc113dc0 0x7f5dcc154ba0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.953+0000 7f5dd13366c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc155340 0x7f5dcc10e000 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dc400c6c0 tx=0x7f5dc400cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.954+0000 7f5dc1ffb6c0 1 -- 10.20.193.40:0/866489127 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5dc4003a30 con 0x7f5dcc155340 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.954+0000 7f5dc1ffb6c0 1 -- 10.20.193.40:0/866489127 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(29 keys) ==== 1188+0+0 (secure 0 0 0) 0x7f5dc4005530 con 0x7f5dcc155340 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.954+0000 7f5dc1ffb6c0 1 -- 10.20.193.40:0/866489127 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5dc400de30 con 0x7f5dcc155340 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.954+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc10f200 con 0x7f5dcc155340 2026-02-13T01:21:37.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.954+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc10f660 con 0x7f5dcc155340 2026-02-13T01:21:37.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.956+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d94005310 con 0x7f5dcc155340 2026-02-13T01:21:37.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.956+0000 7f5dc1ffb6c0 1 -- 10.20.193.40:0/866489127 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f5dc4003b90 con 0x7f5dcc155340 2026-02-13T01:21:37.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.956+0000 7f5dc1ffb6c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5d9803f7f0 0x7f5d9805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:37.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.957+0000 7f5dc1ffb6c0 1 -- 10.20.193.40:0/866489127 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f5dc400f030 con 0x7f5dcc155340 2026-02-13T01:21:37.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.957+0000 7f5dd0b356c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5d9803f7f0 0x7f5d9805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:37.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.957+0000 7f5dd0b356c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5d9803f7f0 0x7f5d9805fca0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dbc005b40 tx=0x7f5dbc009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:37.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:37.959+0000 7f5dc1ffb6c0 1 -- 10.20.193.40:0/866489127 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5dc4009aa0 con 0x7f5dcc155340 2026-02-13T01:21:37.968 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2026-02-13T01:21:37.968 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/log_level debug 2026-02-13T01:21:38.021 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T01:21:38.022 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: Optimize plan auto_2026-02-13_01:21:35, mode upmap, max misplaced 0.050000 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: No pools available 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: mgrmap e11: x(active, since 1.00811s) 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial040=x;trial055=y;trial118=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.023 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.024 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial055", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:38.024 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.024 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial118", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:38.024 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:38.024 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2552884322' entity='client.admin' 2026-02-13T01:21:38.024 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:37 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:38.024 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.028 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.027+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fcbc80587e0 con 0x7fcbc805e760 2026-02-13T01:21:38.034 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-13T01:21:38.034 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-13T01:21:38.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.038+0000 7f5dc1ffb6c0 1 -- 10.20.193.40:0/866489127 <== mon.2 v2:10.20.193.55:3300/0 7 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5dc4009900 con 0x7f5dcc155340 2026-02-13T01:21:38.042 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-13T01:21:38.043 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-13T01:21:38.069 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.037+0000 7fcbc5ffb6c0 1 -- 10.20.193.40:0/146834022 <== mon.1 v2:10.20.193.118:3300/0 8 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fcbb003aea0 con 0x7fcbc805e760 2026-02-13T01:21:38.069 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.037+0000 7fcbc5ffb6c0 1 -- 10.20.193.40:0/146834022 <== mon.1 v2:10.20.193.118:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7fcbb0031030 con 0x7fcbc805e760 2026-02-13T01:21:38.069 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.040+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb9c03f870 msgr2=0x7fcb9c05fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.069 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.040+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb9c03f870 0x7fcb9c05fd20 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbbc005b40 tx=0x7fcbbc009310 comp rx=0 tx=0).stop 2026-02-13T01:21:38.069 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.040+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcbc805e760 msgr2=0x7fcbc81b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.069 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.040+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcbc805e760 0x7fcbc81b4680 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbb00099d0 tx=0x7fcbb0005800 comp rx=0 tx=0).stop 2026-02-13T01:21:38.069 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.042+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 shutdown_connections 2026-02-13T01:21:38.069 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.042+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb9c03f870 0x7fcb9c05fd20 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.070 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.042+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcbc8114f40 0x7fcbc81b58c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.070 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.042+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcbc81143e0 0x7fcbc81b4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.070 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.042+0000 7fcbcdec36c0 1 --2- 10.20.193.40:0/146834022 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcbc805e760 0x7fcbc81b4680 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.070 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.042+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 >> 10.20.193.40:0/146834022 conn(0x7fcbc805b720 msgr2=0x7fcbc81aad10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.070 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.042+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 shutdown_connections 2026-02-13T01:21:38.070 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.042+0000 7fcbcdec36c0 1 -- 10.20.193.40:0/146834022 wait complete. 2026-02-13T01:21:38.070 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.072+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f5d94005890 con 0x7f5dcc155340 2026-02-13T01:21:38.082 DEBUG:tasks.cephadm:set 30 configs 2026-02-13T01:21:38.082 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial040') 2026-02-13T01:21:38.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.079+0000 7f5dc1ffb6c0 1 -- 10.20.193.40:0/866489127 <== mon.2 v2:10.20.193.55:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7f5dc4009c40 con 0x7f5dcc155340 2026-02-13T01:21:38.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.082+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5d9803f7f0 msgr2=0x7f5d9805fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.082+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5d9803f7f0 0x7f5d9805fca0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dbc005b40 tx=0x7f5dbc009310 comp rx=0 tx=0).stop 2026-02-13T01:21:38.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.082+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc155340 msgr2=0x7f5dcc10e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.082+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc155340 0x7f5dcc10e000 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dc400c6c0 tx=0x7f5dc400cb90 comp rx=0 tx=0).stop 2026-02-13T01:21:38.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.082+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 shutdown_connections 2026-02-13T01:21:38.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.082+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5d9803f7f0 0x7f5d9805fca0 unknown :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.082+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5dcc155340 0x7f5dcc10e000 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.082+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5dcc1347c0 0x7f5dcc10d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.082+0000 7f5dd1b376c0 1 --2- 10.20.193.40:0/866489127 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5dcc113dc0 0x7f5dcc154ba0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.083+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 >> 10.20.193.40:0/866489127 conn(0x7f5dcc05b720 msgr2=0x7f5dcc1141e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.083+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 shutdown_connections 2026-02-13T01:21:38.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.083+0000 7f5dd1b376c0 1 -- 10.20.193.40:0/866489127 wait complete. 2026-02-13T01:21:38.106 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.101+0000 7f5edd1356c0 1 -- 10.20.193.40:0/3789442125 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed8134920 msgr2=0x7f5ed8154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.107 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.101+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/3789442125 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed8134920 0x7f5ed8154da0 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=14023237322303976943 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ecc009970 tx=0x7f5ecc02ed20 comp rx=0 tx=0).stop 2026-02-13T01:21:38.107 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.101+0000 7f5edd1356c0 1 -- 10.20.193.40:0/3789442125 shutdown_connections 2026-02-13T01:21:38.107 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.102+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/3789442125 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ed81554e0 0x7f5ed8175990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.107 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.102+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/3789442125 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed8134920 0x7f5ed8154da0 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=14023237322303976943 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.107 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.102+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/3789442125 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ed8113f70 0x7f5ed8134350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.107 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.102+0000 7f5edd1356c0 1 -- 10.20.193.40:0/3789442125 >> 10.20.193.40:0/3789442125 conn(0x7f5ed805b8e0 msgr2=0x7f5ed805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.107 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.102+0000 7f5edd1356c0 1 -- 10.20.193.40:0/3789442125 shutdown_connections 2026-02-13T01:21:38.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.102+0000 7f5edd1356c0 1 -- 10.20.193.40:0/3789442125 wait complete. 2026-02-13T01:21:38.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.103+0000 7f5edd1356c0 1 Processor -- start 2026-02-13T01:21:38.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.103+0000 7f5edd1356c0 1 -- start start 2026-02-13T01:21:38.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.103+0000 7f5edd1356c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ed8113f70 0x7f5ed8175990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5edd1356c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ed8134920 0x7f5ed8154d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5edd1356c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed81554e0 0x7f5ed80ff930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5edd1356c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed81000c0 con 0x7f5ed8134920 2026-02-13T01:21:38.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5edd1356c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed8100230 con 0x7f5ed81554e0 2026-02-13T01:21:38.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5edd1356c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed8100870 con 0x7f5ed8113f70 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5ed6d766c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ed8113f70 0x7f5ed8175990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5ed6d766c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ed8113f70 0x7f5ed8175990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:45856/0 (socket says 10.20.193.40:45856) 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5ed75776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed81554e0 0x7f5ed80ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5ed75776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed81554e0 0x7f5ed80ff930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43366/0 (socket says 10.20.193.40:43366) 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5ed75776c0 1 -- 10.20.193.40:0/1881932662 learned_addr learned my addr 10.20.193.40:0/1881932662 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.104+0000 7f5ed65756c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ed8134920 0x7f5ed8154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f5ed75776c0 1 -- 10.20.193.40:0/1881932662 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ed8113f70 msgr2=0x7f5ed8175990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f5ed75776c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ed8113f70 0x7f5ed8175990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f5ed75776c0 1 -- 10.20.193.40:0/1881932662 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ed8134920 msgr2=0x7f5ed8154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f5ed75776c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ed8134920 0x7f5ed8154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f5ed75776c0 1 -- 10.20.193.40:0/1881932662 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc009590 con 0x7f5ed81554e0 2026-02-13T01:21:38.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f5ed75776c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed81554e0 0x7f5ed80ff930 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec8006ea0 tx=0x7f5ec800cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.110 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.106+0000 7f5eb7fff6c0 1 -- 10.20.193.40:0/1881932662 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ec8003a30 con 0x7f5ed81554e0 2026-02-13T01:21:38.110 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f17928596c0 1 -- 10.20.193.40:0/927450266 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f178c1146f0 msgr2=0x7f178c114b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.110 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f17928596c0 1 --2- 10.20.193.40:0/927450266 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f178c1146f0 0x7f178c114b60 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=8897716192522669285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1774009970 tx=0x7f177402edc0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.110 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f17928596c0 1 -- 10.20.193.40:0/927450266 shutdown_connections 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f17928596c0 1 --2- 10.20.193.40:0/927450266 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f178c115120 0x7f178c1155c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f17928596c0 1 --2- 10.20.193.40:0/927450266 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f178c1146f0 0x7f178c114b60 unknown :-1 s=CLOSED pgs=9 gs=2 cs=0 l=1 c_cookie=8897716192522669285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f17928596c0 1 --2- 10.20.193.40:0/927450266 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f178c113dc0 0x7f178c1141b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f17928596c0 1 -- 10.20.193.40:0/927450266 >> 10.20.193.40:0/927450266 conn(0x7f178c05bd20 msgr2=0x7f178c05c140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f17928596c0 1 -- 10.20.193.40:0/927450266 shutdown_connections 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.105+0000 7f17928596c0 1 -- 10.20.193.40:0/927450266 wait complete. 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.107+0000 7f17928596c0 1 Processor -- start 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.107+0000 7f17928596c0 1 -- start start 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.107+0000 7f17928596c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f178c113dc0 0x7f178c0ff720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.107+0000 7f17928596c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f178c1146f0 0x7f178c0ffd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.107+0000 7f17928596c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f178c115120 0x7f178c100960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f178b7fe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f178c1146f0 0x7f178c0ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f178b7fe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f178c1146f0 0x7f178c0ffd70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43376/0 (socket says 10.20.193.40:43376) 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f1790dcb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f178c115120 0x7f178c100960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f1790dcb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f178c115120 0x7f178c100960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47764/0 (socket says 10.20.193.40:47764) 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f178b7fe6c0 1 -- 10.20.193.40:0/837873634 learned_addr learned my addr 10.20.193.40:0/837873634 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f178bfff6c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f178c113dc0 0x7f178c0ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f178c1010f0 con 0x7f178c115120 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f178c101260 con 0x7f178c1146f0 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f178c101420 con 0x7f178c113dc0 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f178b7fe6c0 1 -- 10.20.193.40:0/837873634 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f178c113dc0 msgr2=0x7f178c0ff720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f178b7fe6c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f178c113dc0 0x7f178c0ff720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f178b7fe6c0 1 -- 10.20.193.40:0/837873634 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f178c115120 msgr2=0x7f178c100960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f178b7fe6c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f178c115120 0x7f178c100960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f178b7fe6c0 1 -- 10.20.193.40:0/837873634 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17800094c0 con 0x7f178c1146f0 2026-02-13T01:21:38.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.109+0000 7f178b7fe6c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f178c1146f0 0x7f178c0ffd70 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1774005b40 tx=0x7f177402f990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.109+0000 7f17897fa6c0 1 -- 10.20.193.40:0/837873634 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1774002ae0 con 0x7f178c1146f0 2026-02-13T01:21:38.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.109+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1774009590 con 0x7f178c1146f0 2026-02-13T01:21:38.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.109+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178c1017e0 con 0x7f178c1146f0 2026-02-13T01:21:38.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.109+0000 7f17897fa6c0 1 -- 10.20.193.40:0/837873634 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f177402fe80 con 0x7f178c1146f0 2026-02-13T01:21:38.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.109+0000 7f17897fa6c0 1 -- 10.20.193.40:0/837873634 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1774002ae0 con 0x7f178c1146f0 2026-02-13T01:21:38.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.110+0000 7f17897fa6c0 1 -- 10.20.193.40:0/837873634 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f17740072f0 con 0x7f178c1146f0 2026-02-13T01:21:38.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.111+0000 7f17897fa6c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f176803f880 0x7f176805fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.111+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1758005310 con 0x7f178c1146f0 2026-02-13T01:21:38.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.111+0000 7f17897fa6c0 1 -- 10.20.193.40:0/837873634 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f1774076320 con 0x7f178c1146f0 2026-02-13T01:21:38.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.112+0000 7f178bfff6c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f176803f880 0x7f176805fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.115 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.112+0000 7f178bfff6c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f176803f880 0x7f176805fd30 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1780004750 tx=0x7f1780009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.115 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.113+0000 7f17897fa6c0 1 -- 10.20.193.40:0/837873634 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1774036400 con 0x7f178c1146f0 2026-02-13T01:21:38.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.106+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed8100b00 con 0x7f5ed81554e0 2026-02-13T01:21:38.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.106+0000 7f5eb7fff6c0 1 -- 10.20.193.40:0/1881932662 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5ec8005560 con 0x7f5ed81554e0 2026-02-13T01:21:38.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.106+0000 7f5eb7fff6c0 1 -- 10.20.193.40:0/1881932662 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ec80082a0 con 0x7f5ed81554e0 2026-02-13T01:21:38.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.108+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed8100fe0 con 0x7f5ed81554e0 2026-02-13T01:21:38.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.111+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed817bde0 con 0x7f5ed81554e0 2026-02-13T01:21:38.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.112+0000 7f5eb7fff6c0 1 -- 10.20.193.40:0/1881932662 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f5ec800d4d0 con 0x7f5ed81554e0 2026-02-13T01:21:38.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.112+0000 7f5eb7fff6c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5eac03f870 0x7f5eac05fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.112+0000 7f5ed6d766c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5eac03f870 0x7f5eac05fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.113+0000 7f5ed6d766c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5eac03f870 0x7f5eac05fd20 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec0004750 tx=0x7f5ec0009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.114+0000 7f5eb7fff6c0 1 -- 10.20.193.40:0/1881932662 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f5ec8025580 con 0x7f5ed81554e0 2026-02-13T01:21:38.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.117+0000 7f5eb7fff6c0 1 -- 10.20.193.40:0/1881932662 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5ec8005d90 con 0x7f5ed81554e0 2026-02-13T01:21:38.171 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.191 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.234+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f5ed817bfc0 con 0x7f5ed81554e0 2026-02-13T01:21:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: Optimize plan auto_2026-02-13_01:21:35, mode upmap, max misplaced 0.050000 2026-02-13T01:21:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: No pools available 2026-02-13T01:21:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: mgrmap e11: x(active, since 1.00811s) 2026-02-13T01:21:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial040=x;trial055=y;trial118=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial055", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:38.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial118", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:38.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:38.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2552884322' entity='client.admin' 2026-02-13T01:21:38.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:37 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:38.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.244+0000 7f5eb7fff6c0 1 -- 10.20.193.40:0/1881932662 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f5ec8006020 con 0x7f5ed81554e0 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: Optimize plan auto_2026-02-13_01:21:35, mode upmap, max misplaced 0.050000 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: No pools available 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: mgrmap e11: x(active, since 1.00811s) 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial040=x;trial055=y;trial118=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial055", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:38.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:38.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial118", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:38.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:38.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2552884322' entity='client.admin' 2026-02-13T01:21:38.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:37 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:38.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.257+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f17580055c0 con 0x7f178c1146f0 2026-02-13T01:21:38.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.265+0000 7f17897fa6c0 1 -- 10.20.193.40:0/837873634 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7f1774049890 con 0x7f178c1146f0 2026-02-13T01:21:38.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.247+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5eac03f870 msgr2=0x7f5eac05fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.247+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5eac03f870 0x7f5eac05fd20 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec0004750 tx=0x7f5ec0009390 comp rx=0 tx=0).stop 2026-02-13T01:21:38.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.247+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed81554e0 msgr2=0x7f5ed80ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.247+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed81554e0 0x7f5ed80ff930 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec8006ea0 tx=0x7f5ec800cca0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.248+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 shutdown_connections 2026-02-13T01:21:38.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.248+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5eac03f870 0x7f5eac05fd20 unknown :-1 s=CLOSED pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.248+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ed81554e0 0x7f5ed80ff930 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.248+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ed8134920 0x7f5ed8154d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.248+0000 7f5edd1356c0 1 --2- 10.20.193.40:0/1881932662 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ed8113f70 0x7f5ed8175990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.248+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 >> 10.20.193.40:0/1881932662 conn(0x7f5ed805b8e0 msgr2=0x7f5ed80f5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.248+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 shutdown_connections 2026-02-13T01:21:38.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.248+0000 7f5edd1356c0 1 -- 10.20.193.40:0/1881932662 wait complete. 2026-02-13T01:21:38.283 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.303+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f176803f880 msgr2=0x7f176805fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.303+0000 7f17928596c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f176803f880 0x7f176805fd30 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1780004750 tx=0x7f1780009260 comp rx=0 tx=0).stop 2026-02-13T01:21:38.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.303+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f178c1146f0 msgr2=0x7f178c0ffd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.303+0000 7f17928596c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f178c1146f0 0x7f178c0ffd70 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1774005b40 tx=0x7f177402f990 comp rx=0 tx=0).stop 2026-02-13T01:21:38.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.304+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 shutdown_connections 2026-02-13T01:21:38.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.304+0000 7f17928596c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f176803f880 0x7f176805fd30 unknown :-1 s=CLOSED pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.304+0000 7f17928596c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f178c115120 0x7f178c100960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.304+0000 7f17928596c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f178c1146f0 0x7f178c0ffd70 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.304+0000 7f17928596c0 1 --2- 10.20.193.40:0/837873634 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f178c113dc0 0x7f178c0ff720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.304+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 >> 10.20.193.40:0/837873634 conn(0x7f178c05bd20 msgr2=0x7f178c0f57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.304+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 shutdown_connections 2026-02-13T01:21:38.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.304+0000 7f17928596c0 1 -- 10.20.193.40:0/837873634 wait complete. 2026-02-13T01:21:38.433 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial040') 2026-02-13T01:21:38.433 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial040') 2026-02-13T01:21:38.434 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial040') 2026-02-13T01:21:38.437 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.577 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.593 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.610+0000 7fb6251976c0 1 -- 10.20.193.40:0/2703166661 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb6180b6340 msgr2=0x7fb618116cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.610+0000 7fb6251976c0 1 --2- 10.20.193.40:0/2703166661 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb6180b6340 0x7fb618116cd0 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=14247817243848783778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb610006fd0 tx=0x7fb61002fd20 comp rx=0 tx=0).stop 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.610+0000 7fb61dd746c0 1 -- 10.20.193.40:0/2703166661 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6100081e0 con 0x7fb6180b6340 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.611+0000 7fb6251976c0 1 -- 10.20.193.40:0/2703166661 shutdown_connections 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.611+0000 7fb6251976c0 1 --2- 10.20.193.40:0/2703166661 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb6180b6340 0x7fb618116cd0 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=14247817243848783778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.611+0000 7fb6251976c0 1 --2- 10.20.193.40:0/2703166661 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb6180b5990 0x7fb6180b5e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.611+0000 7fb6251976c0 1 --2- 10.20.193.40:0/2703166661 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb6180b4810 0x7fb6180b4c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.611+0000 7fb6251976c0 1 -- 10.20.193.40:0/2703166661 >> 10.20.193.40:0/2703166661 conn(0x7fb618091f30 msgr2=0x7fb6180b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.611+0000 7fb6251976c0 1 -- 10.20.193.40:0/2703166661 shutdown_connections 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.611+0000 7fb6251976c0 1 -- 10.20.193.40:0/2703166661 wait complete. 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.612+0000 7fb6251976c0 1 Processor -- start 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.612+0000 7fb6251976c0 1 -- start start 2026-02-13T01:21:38.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.613+0000 7fb6251976c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb6180b4810 0x7fb61809fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.613+0000 7fb6251976c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb6180b5990 0x7fb618116cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.613+0000 7fb6251976c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb6180b6340 0x7fb6180a04e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.613+0000 7fb6251976c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb6180a1130 con 0x7fb6180b5990 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.613+0000 7fb6251976c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb6180a12a0 con 0x7fb6180b4810 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.613+0000 7fb6251976c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb6180a1460 con 0x7fb6180b6340 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61ed766c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb6180b4810 0x7fb61809fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61f5776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb6180b6340 0x7fb6180a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61f5776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb6180b6340 0x7fb6180a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:45878/0 (socket says 10.20.193.40:45878) 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61f5776c0 1 -- 10.20.193.40:0/1830602916 learned_addr learned my addr 10.20.193.40:0/1830602916 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61f5776c0 1 -- 10.20.193.40:0/1830602916 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb6180b4810 msgr2=0x7fb61809fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61f5776c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb6180b4810 0x7fb61809fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61f5776c0 1 -- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb6180b5990 msgr2=0x7fb618116cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61e5756c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb6180b5990 0x7fb618116cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61f5776c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb6180b5990 0x7fb618116cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61f5776c0 1 -- 10.20.193.40:0/1830602916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb614009590 con 0x7fb6180b6340 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61ed766c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb6180b4810 0x7fb61809fca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.614+0000 7fb61e5756c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb6180b5990 0x7fb618116cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.615+0000 7fb61f5776c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb6180b6340 0x7fb6180a04e0 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61000aa80 tx=0x7fb610003a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.615+0000 7fb5fffff6c0 1 -- 10.20.193.40:0/1830602916 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6100081c0 con 0x7fb6180b6340 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.615+0000 7fb5fffff6c0 1 -- 10.20.193.40:0/1830602916 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb61000a030 con 0x7fb6180b6340 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.615+0000 7fb5fffff6c0 1 -- 10.20.193.40:0/1830602916 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb610036760 con 0x7fb6180b6340 2026-02-13T01:21:38.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.615+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61000a5b0 con 0x7fb6180b6340 2026-02-13T01:21:38.620 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.615+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6180a1920 con 0x7fb6180b6340 2026-02-13T01:21:38.620 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.617+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61811b010 con 0x7fb6180b6340 2026-02-13T01:21:38.620 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.617+0000 7fb5fffff6c0 1 -- 10.20.193.40:0/1830602916 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fb6100368f0 con 0x7fb6180b6340 2026-02-13T01:21:38.621 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.617+0000 7fb5fffff6c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb5f403f870 0x7fb5f405fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.617+0000 7fb5fffff6c0 1 -- 10.20.193.40:0/1830602916 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fb6100764b0 con 0x7fb6180b6340 2026-02-13T01:21:38.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.618+0000 7fb61ed766c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb5f403f870 0x7fb5f405fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.618+0000 7fb61ed766c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb5f403f870 0x7fb5f405fd20 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb614005b40 tx=0x7fb614009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.619+0000 7fb5fffff6c0 1 -- 10.20.193.40:0/1830602916 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb6100024e0 con 0x7fb6180b6340 2026-02-13T01:21:38.629 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.640 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.653 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.663 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.665 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.687 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.691+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3858046834 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0c1c113dc0 msgr2=0x7f0c1c1341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.691+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3858046834 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0c1c113dc0 0x7f0c1c1341a0 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=2372657105250521431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c18006fd0 tx=0x7f0c18030630 comp rx=0 tx=0).stop 2026-02-13T01:21:38.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.694+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3858046834 shutdown_connections 2026-02-13T01:21:38.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.694+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3858046834 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0c1c155340 0x7f0c1c1757f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.694+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3858046834 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0c1c1347c0 0x7f0c1c154c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.694+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3858046834 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0c1c113dc0 0x7f0c1c1341a0 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=2372657105250521431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.694+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3858046834 >> 10.20.193.40:0/3858046834 conn(0x7f0c1c05b720 msgr2=0x7f0c1c05bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.694+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3858046834 shutdown_connections 2026-02-13T01:21:38.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.694+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3858046834 wait complete. 2026-02-13T01:21:38.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.695+0000 7f0c22f536c0 1 Processor -- start 2026-02-13T01:21:38.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.696+0000 7f0c22f536c0 1 -- start start 2026-02-13T01:21:38.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.696+0000 7f0c22f536c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0c1c113dc0 0x7f0c1c1757c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.696+0000 7f0c22f536c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0c1c1347c0 0x7f0c1c154ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.696+0000 7f0c22f536c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0c1c155340 0x7f0c1c1146a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.696+0000 7f0c22f536c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c114e30 con 0x7f0c1c113dc0 2026-02-13T01:21:38.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.696+0000 7f0c22f536c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c114fa0 con 0x7f0c1c155340 2026-02-13T01:21:38.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.696+0000 7f0c22f536c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c1155b0 con 0x7f0c1c1347c0 2026-02-13T01:21:38.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.697+0000 7f0c217506c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0c1c1347c0 0x7f0c1c154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.697+0000 7f0c217506c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0c1c1347c0 0x7f0c1c154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:45888/0 (socket says 10.20.193.40:45888) 2026-02-13T01:21:38.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.697+0000 7f0c217506c0 1 -- 10.20.193.40:0/3361750910 learned_addr learned my addr 10.20.193.40:0/3361750910 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:38.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.697+0000 7f0c227526c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0c1c155340 0x7f0c1c1146a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.697+0000 7f0c21f516c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0c1c113dc0 0x7f0c1c1757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.698+0000 7f0c21f516c0 1 -- 10.20.193.40:0/3361750910 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0c1c1347c0 msgr2=0x7f0c1c154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.698+0000 7f0c21f516c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0c1c1347c0 0x7f0c1c154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.698+0000 7f0c21f516c0 1 -- 10.20.193.40:0/3361750910 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0c1c155340 msgr2=0x7f0c1c1146a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.698+0000 7f0c21f516c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0c1c155340 0x7f0c1c1146a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.698+0000 7f0c21f516c0 1 -- 10.20.193.40:0/3361750910 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1c115770 con 0x7f0c1c113dc0 2026-02-13T01:21:38.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.698+0000 7f0c21f516c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0c1c113dc0 0x7f0c1c1757c0 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c1800c210 tx=0x7f0c18003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.698+0000 7f0c0affd6c0 1 -- 10.20.193.40:0/3361750910 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c1800a4b0 con 0x7f0c1c113dc0 2026-02-13T01:21:38.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.698+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1c1159c0 con 0x7f0c1c113dc0 2026-02-13T01:21:38.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.698+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c1c115e40 con 0x7f0c1c113dc0 2026-02-13T01:21:38.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.699+0000 7f0c0affd6c0 1 -- 10.20.193.40:0/3361750910 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0c1800ae60 con 0x7f0c1c113dc0 2026-02-13T01:21:38.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.699+0000 7f0c0affd6c0 1 -- 10.20.193.40:0/3361750910 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c180054e0 con 0x7f0c1c113dc0 2026-02-13T01:21:38.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.699+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be4005310 con 0x7f0c1c113dc0 2026-02-13T01:21:38.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.701+0000 7f0c0affd6c0 1 -- 10.20.193.40:0/3361750910 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f0c18006260 con 0x7f0c1c113dc0 2026-02-13T01:21:38.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.701+0000 7f0c0affd6c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0bf803f820 0x7f0bf805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.701+0000 7f0c0affd6c0 1 -- 10.20.193.40:0/3361750910 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f0c18036040 con 0x7f0c1c113dc0 2026-02-13T01:21:38.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.702+0000 7f0c0affd6c0 1 -- 10.20.193.40:0/3361750910 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0c18005a00 con 0x7f0c1c113dc0 2026-02-13T01:21:38.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.704+0000 7f0c217506c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0bf803f820 0x7f0bf805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.704+0000 7f0c217506c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0bf803f820 0x7f0bf805fcd0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c0c009260 tx=0x7f0c0c009440 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.730+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fb61811a960 con 0x7fb6180b6340 2026-02-13T01:21:38.734 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.732+0000 7fb5fffff6c0 1 -- 10.20.193.40:0/1830602916 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fb6100083e0 con 0x7fb6180b6340 2026-02-13T01:21:38.734 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.733+0000 7f0c0affd6c0 1 -- 10.20.193.40:0/3361750910 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f0c1800a610 con 0x7f0c1c113dc0 2026-02-13T01:21:38.741 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.735+0000 7fb5fffff6c0 1 -- 10.20.193.40:0/1830602916 <== mon.1 v2:10.20.193.118:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 127+0+0 (secure 0 0 0) 0x7fb610034da0 con 0x7fb6180b6340 2026-02-13T01:21:38.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.757+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb5f403f870 msgr2=0x7fb5f405fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.757+0000 7fb6251976c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb5f403f870 0x7fb5f405fd20 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb614005b40 tx=0x7fb614009310 comp rx=0 tx=0).stop 2026-02-13T01:21:38.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.757+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb6180b6340 msgr2=0x7fb6180a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.757+0000 7fb6251976c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb6180b6340 0x7fb6180a04e0 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61000aa80 tx=0x7fb610003a40 comp rx=0 tx=0).stop 2026-02-13T01:21:38.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.758+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 shutdown_connections 2026-02-13T01:21:38.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.758+0000 7fb6251976c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb5f403f870 0x7fb5f405fd20 unknown :-1 s=CLOSED pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.758+0000 7fb6251976c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb6180b6340 0x7fb6180a04e0 unknown :-1 s=CLOSED pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.758+0000 7fb6251976c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb6180b5990 0x7fb618116cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.758+0000 7fb6251976c0 1 --2- 10.20.193.40:0/1830602916 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb6180b4810 0x7fb61809fca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.758+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 >> 10.20.193.40:0/1830602916 conn(0x7fb618091f30 msgr2=0x7fb618006b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.758+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 shutdown_connections 2026-02-13T01:21:38.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.758+0000 7fb6251976c0 1 -- 10.20.193.40:0/1830602916 wait complete. 2026-02-13T01:21:38.763 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial040') 2026-02-13T01:21:38.763 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial040') 2026-02-13T01:21:38.779 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.782 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial040') 2026-02-13T01:21:38.782 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial040') 2026-02-13T01:21:38.783 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial040') 2026-02-13T01:21:38.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.788+0000 7f929acec6c0 1 -- 10.20.193.40:0/3485707443 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 msgr2=0x7f92941141b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.788+0000 7f929acec6c0 1 --2- 10.20.193.40:0/3485707443 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 0x7f92941141b0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=10548403675167099261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9284009970 tx=0x7f928402eda0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.790+0000 7f929acec6c0 1 -- 10.20.193.40:0/3485707443 shutdown_connections 2026-02-13T01:21:38.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.790+0000 7f929acec6c0 1 --2- 10.20.193.40:0/3485707443 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9294115120 0x7f92941155c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.790+0000 7f929acec6c0 1 --2- 10.20.193.40:0/3485707443 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f92941146f0 0x7f9294114b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.790+0000 7f929acec6c0 1 --2- 10.20.193.40:0/3485707443 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 0x7f92941141b0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=10548403675167099261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.790+0000 7f929acec6c0 1 -- 10.20.193.40:0/3485707443 >> 10.20.193.40:0/3485707443 conn(0x7f929405b8e0 msgr2=0x7f929405bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.790+0000 7f929acec6c0 1 -- 10.20.193.40:0/3485707443 shutdown_connections 2026-02-13T01:21:38.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.790+0000 7f929acec6c0 1 -- 10.20.193.40:0/3485707443 wait complete. 2026-02-13T01:21:38.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.790+0000 7f929acec6c0 1 Processor -- start 2026-02-13T01:21:38.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.790+0000 7f929acec6c0 1 -- start start 2026-02-13T01:21:38.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.791+0000 7f929acec6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 0x7f929411c1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.791+0000 7f929acec6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f92941146f0 0x7f929411c840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.791+0000 7f929acec6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9294115120 0x7f929411d430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.791+0000 7f9298a616c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 0x7f929411c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.791+0000 7f9298a616c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 0x7f929411c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:45916/0 (socket says 10.20.193.40:45916) 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.791+0000 7f9298a616c0 1 -- 10.20.193.40:0/806176073 learned_addr learned my addr 10.20.193.40:0/806176073 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.791+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f929411dbc0 con 0x7f9294115120 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.791+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f929411dd30 con 0x7f92941146f0 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.791+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f929411def0 con 0x7f9294113dc0 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.792+0000 7f928bfff6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f92941146f0 0x7f929411c840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.792+0000 7f92992626c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9294115120 0x7f929411d430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.792+0000 7f9298a616c0 1 -- 10.20.193.40:0/806176073 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f92941146f0 msgr2=0x7f929411c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.792+0000 7f9298a616c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f92941146f0 0x7f929411c840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.792+0000 7f9298a616c0 1 -- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9294115120 msgr2=0x7f929411d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.792+0000 7f9298a616c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9294115120 0x7f929411d430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.792+0000 7f9298a616c0 1 -- 10.20.193.40:0/806176073 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9284009590 con 0x7f9294113dc0 2026-02-13T01:21:38.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.792+0000 7f92992626c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9294115120 0x7f929411d430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:38.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.793+0000 7f9298a616c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 0x7f929411c1f0 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92840092e0 tx=0x7f928402f880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.793+0000 7f9289ffb6c0 1 -- 10.20.193.40:0/806176073 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92840028d0 con 0x7f9294113dc0 2026-02-13T01:21:38.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.793+0000 7f9289ffb6c0 1 -- 10.20.193.40:0/806176073 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9284007350 con 0x7f9294113dc0 2026-02-13T01:21:38.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.794+0000 7f9289ffb6c0 1 -- 10.20.193.40:0/806176073 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9284031420 con 0x7f9294113dc0 2026-02-13T01:21:38.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.794+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929411e170 con 0x7f9294113dc0 2026-02-13T01:21:38.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.794+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f929415e670 con 0x7f9294113dc0 2026-02-13T01:21:38.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.795+0000 7f9289ffb6c0 1 -- 10.20.193.40:0/806176073 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f92840315b0 con 0x7f9294113dc0 2026-02-13T01:21:38.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.795+0000 7f9289ffb6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f926403f990 0x7f926405fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.795+0000 7f9289ffb6c0 1 -- 10.20.193.40:0/806176073 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f9284076890 con 0x7f9294113dc0 2026-02-13T01:21:38.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.796+0000 7f928bfff6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f926403f990 0x7f926405fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.796+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9294119040 con 0x7f9294113dc0 2026-02-13T01:21:38.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.797+0000 7f928bfff6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f926403f990 0x7f926405fe40 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f927c004750 tx=0x7f927c009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.800+0000 7f9289ffb6c0 1 -- 10.20.193.40:0/806176073 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9284033920 con 0x7f9294113dc0 2026-02-13T01:21:38.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.768+0000 7f47a345f6c0 1 -- 10.20.193.40:0/1874344410 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f479c113dc0 msgr2=0x7f479c1341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.768+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/1874344410 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f479c113dc0 0x7f479c1341a0 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=9005052244488519840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4788009970 tx=0x7f478802ed20 comp rx=0 tx=0).stop 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.768+0000 7f47a345f6c0 1 -- 10.20.193.40:0/1874344410 shutdown_connections 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.768+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/1874344410 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f479c155340 0x7f479c1757f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.768+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/1874344410 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f479c1347c0 0x7f479c154c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.768+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/1874344410 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f479c113dc0 0x7f479c1341a0 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=9005052244488519840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.768+0000 7f47a345f6c0 1 -- 10.20.193.40:0/1874344410 >> 10.20.193.40:0/1874344410 conn(0x7f479c05b720 msgr2=0x7f479c05bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.768+0000 7f47a345f6c0 1 -- 10.20.193.40:0/1874344410 shutdown_connections 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.768+0000 7f47a345f6c0 1 -- 10.20.193.40:0/1874344410 wait complete. 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.770+0000 7f47a345f6c0 1 Processor -- start 2026-02-13T01:21:38.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.775+0000 7f47a345f6c0 1 -- start start 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.775+0000 7f47a345f6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f479c113dc0 0x7f479c154c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.775+0000 7f47a345f6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f479c1347c0 0x7f479c175790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.775+0000 7f47a345f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f479c155340 0x7f479c11c450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.775+0000 7f47a345f6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f479c11cbe0 con 0x7f479c113dc0 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.776+0000 7f47a345f6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f479c11cd50 con 0x7f479c155340 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.776+0000 7f47a345f6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f479c11d340 con 0x7f479c1347c0 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.776+0000 7f47a2c5e6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f479c155340 0x7f479c11c450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.776+0000 7f47a2c5e6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f479c155340 0x7f479c11c450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43434/0 (socket says 10.20.193.40:43434) 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.776+0000 7f47a2c5e6c0 1 -- 10.20.193.40:0/2815992764 learned_addr learned my addr 10.20.193.40:0/2815992764 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.777+0000 7f47a1c5c6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f479c1347c0 0x7f479c175790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.777+0000 7f47a2c5e6c0 1 -- 10.20.193.40:0/2815992764 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f479c1347c0 msgr2=0x7f479c175790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.777+0000 7f47a2c5e6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f479c1347c0 0x7f479c175790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.777+0000 7f47a2c5e6c0 1 -- 10.20.193.40:0/2815992764 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f479c113dc0 msgr2=0x7f479c154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.777+0000 7f47a2c5e6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f479c113dc0 0x7f479c154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.777+0000 7f47a2c5e6c0 1 -- 10.20.193.40:0/2815992764 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c0094c0 con 0x7f479c155340 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.777+0000 7f47a2c5e6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f479c155340 0x7f479c11c450 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f479400d050 tx=0x7f479400df30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.778+0000 7f479b7fe6c0 1 -- 10.20.193.40:0/2815992764 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f479400a250 con 0x7f479c155340 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.778+0000 7f479b7fe6c0 1 -- 10.20.193.40:0/2815992764 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4794003d40 con 0x7f479c155340 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.778+0000 7f479b7fe6c0 1 -- 10.20.193.40:0/2815992764 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47940083f0 con 0x7f479c155340 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.779+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47940081c0 con 0x7f479c155340 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.779+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4788009590 con 0x7f479c155340 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.779+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479c11e180 con 0x7f479c155340 2026-02-13T01:21:38.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.784+0000 7f479b7fe6c0 1 -- 10.20.193.40:0/2815992764 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f4794005340 con 0x7f479c155340 2026-02-13T01:21:38.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.784+0000 7f479b7fe6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f476803f990 0x7f476805fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:38.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.784+0000 7f479b7fe6c0 1 -- 10.20.193.40:0/2815992764 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4794052650 con 0x7f479c155340 2026-02-13T01:21:38.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.784+0000 7f47a245d6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f476803f990 0x7f476805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:38.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.785+0000 7f47a245d6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f476803f990 0x7f476805fe40 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47880098c0 tx=0x7f4788005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:38.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.787+0000 7f479b7fe6c0 1 -- 10.20.193.40:0/2815992764 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4794006210 con 0x7f479c155340 2026-02-13T01:21:38.809 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:38.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.890+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f0be40055c0 con 0x7f0c1c113dc0 2026-02-13T01:21:38.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.895+0000 7f0c0affd6c0 1 -- 10.20.193.40:0/3361750910 <== mon.0 v2:10.20.193.40:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7f0c180378c0 con 0x7f0c1c113dc0 2026-02-13T01:21:38.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.898+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f479c179500 con 0x7f479c155340 2026-02-13T01:21:38.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.900+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0bf803f820 msgr2=0x7f0bf805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.900+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0bf803f820 0x7f0bf805fcd0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c0c009260 tx=0x7f0c0c009440 comp rx=0 tx=0).stop 2026-02-13T01:21:38.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.900+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0c1c113dc0 msgr2=0x7f0c1c1757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.900+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0c1c113dc0 0x7f0c1c1757c0 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c1800c210 tx=0x7f0c18003a40 comp rx=0 tx=0).stop 2026-02-13T01:21:38.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.902+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 shutdown_connections 2026-02-13T01:21:38.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.902+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0bf803f820 0x7f0bf805fcd0 unknown :-1 s=CLOSED pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.902+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0c1c155340 0x7f0c1c1146a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.902+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0c1c1347c0 0x7f0c1c154ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.902+0000 7f0c22f536c0 1 --2- 10.20.193.40:0/3361750910 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0c1c113dc0 0x7f0c1c1757c0 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.902+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 >> 10.20.193.40:0/3361750910 conn(0x7f0c1c05b720 msgr2=0x7f0c1c17c870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.902+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 shutdown_connections 2026-02-13T01:21:38.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.903+0000 7f0c22f536c0 1 -- 10.20.193.40:0/3361750910 wait complete. 2026-02-13T01:21:38.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.902+0000 7f479b7fe6c0 1 -- 10.20.193.40:0/2815992764 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v19)=0 v19) ==== 122+0+0 (secure 0 0 0) 0x7f4794006210 con 0x7f479c155340 2026-02-13T01:21:38.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.908+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f476803f990 msgr2=0x7f476805fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.908+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f476803f990 0x7f476805fe40 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47880098c0 tx=0x7f4788005c00 comp rx=0 tx=0).stop 2026-02-13T01:21:38.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.908+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f479c155340 msgr2=0x7f479c11c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.908+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f479c155340 0x7f479c11c450 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f479400d050 tx=0x7f479400df30 comp rx=0 tx=0).stop 2026-02-13T01:21:38.917 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.915+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 shutdown_connections 2026-02-13T01:21:38.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.925+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f92941186e0 con 0x7f9294113dc0 2026-02-13T01:21:38.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.915+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f476803f990 0x7f476805fe40 unknown :-1 s=CLOSED pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.915+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f479c155340 0x7f479c11c450 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.915+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f479c1347c0 0x7f479c175790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.915+0000 7f47a345f6c0 1 --2- 10.20.193.40:0/2815992764 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f479c113dc0 0x7f479c154c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.915+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 >> 10.20.193.40:0/2815992764 conn(0x7f479c05b720 msgr2=0x7f479c17ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.916+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 shutdown_connections 2026-02-13T01:21:38.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.917+0000 7f47a345f6c0 1 -- 10.20.193.40:0/2815992764 wait complete. 2026-02-13T01:21:38.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.932+0000 7f9289ffb6c0 1 -- 10.20.193.40:0/806176073 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v20)=0 v20) ==== 118+0+0 (secure 0 0 0) 0x7f92840328d0 con 0x7f9294113dc0 2026-02-13T01:21:38.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f926403f990 msgr2=0x7f926405fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f926403f990 0x7f926405fe40 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f927c004750 tx=0x7f927c009390 comp rx=0 tx=0).stop 2026-02-13T01:21:38.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 msgr2=0x7f929411c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:38.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 0x7f929411c1f0 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92840092e0 tx=0x7f928402f880 comp rx=0 tx=0).stop 2026-02-13T01:21:38.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 shutdown_connections 2026-02-13T01:21:38.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f926403f990 0x7f926405fe40 unknown :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9294115120 0x7f929411d430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f92941146f0 0x7f929411c840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 --2- 10.20.193.40:0/806176073 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9294113dc0 0x7f929411c1f0 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:38.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 >> 10.20.193.40:0/806176073 conn(0x7f929405b8e0 msgr2=0x7f929417dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:38.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 shutdown_connections 2026-02-13T01:21:38.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:38.942+0000 7f929acec6c0 1 -- 10.20.193.40:0/806176073 wait complete. 2026-02-13T01:21:38.950 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:39.037 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:38 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.037 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:38 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.037 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:38 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.037 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:38 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.037 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:38 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.038 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:38 trial040 ceph-mon[23046]: mgrmap e12: x(active, since 2s) 2026-02-13T01:21:39.038 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:38 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.038 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:38 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3361750910' entity='client.admin' 2026-02-13T01:21:39.038 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:38 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.067 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:39.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.000+0000 7fd7f65756c0 1 --2- 10.20.193.40:0/1727170538 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7f810ecf0 0x7fd7f810f0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:21:39.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.000+0000 7fd7f75776c0 1 -- 10.20.193.40:0/1727170538 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7f8110820 msgr2=0x7fd7f81711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.000+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/1727170538 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7f8110820 0x7fd7f81711b0 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=618558868606006776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7e800aa40 tx=0x7fd7e802fe10 comp rx=0 tx=0).stop 2026-02-13T01:21:39.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.002+0000 7fd7f75776c0 1 -- 10.20.193.40:0/1727170538 shutdown_connections 2026-02-13T01:21:39.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.002+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/1727170538 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7f8110820 0x7fd7f81711b0 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=618558868606006776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.002+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/1727170538 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7f810fe70 0x7fd7f81102e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.002+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/1727170538 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7f810ecf0 0x7fd7f810f0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.002+0000 7fd7f75776c0 1 -- 10.20.193.40:0/1727170538 >> 10.20.193.40:0/1727170538 conn(0x7fd7f80ec410 msgr2=0x7fd7f810c820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.002+0000 7fd7f75776c0 1 -- 10.20.193.40:0/1727170538 shutdown_connections 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.002+0000 7fd7f75776c0 1 -- 10.20.193.40:0/1727170538 wait complete. 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.003+0000 7fd7f75776c0 1 Processor -- start 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.003+0000 7fd7f75776c0 1 -- start start 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.003+0000 7fd7f75776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7f810ecf0 0x7fd7f80f8030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f75776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7f810fe70 0x7fd7f8171190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f75776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7f8110820 0x7fd7f80f8870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f75776c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f80f9430 con 0x7fd7f810ecf0 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f75776c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f80f95a0 con 0x7fd7f8110820 2026-02-13T01:21:39.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f75776c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f80f9760 con 0x7fd7f810fe70 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f5d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7f810fe70 0x7fd7f8171190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f5d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7f810fe70 0x7fd7f8171190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:45934/0 (socket says 10.20.193.40:45934) 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f5d746c0 1 -- 10.20.193.40:0/2877731674 learned_addr learned my addr 10.20.193.40:0/2877731674 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f5d746c0 1 -- 10.20.193.40:0/2877731674 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7f8110820 msgr2=0x7fd7f80f8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f5d746c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7f8110820 0x7fd7f80f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f5d746c0 1 -- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7f810ecf0 msgr2=0x7fd7f80f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f65756c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7f810ecf0 0x7fd7f80f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f5d746c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7f810ecf0 0x7fd7f80f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f5d746c0 1 -- 10.20.193.40:0/2877731674 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e800a660 con 0x7fd7f810fe70 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.008+0000 7fd7f65756c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7f810ecf0 0x7fd7f80f8030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:21:39.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.009+0000 7fd7f5d746c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7f810fe70 0x7fd7f8171190 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7ec009490 tx=0x7fd7ec00bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.009+0000 7fd7df7fe6c0 1 -- 10.20.193.40:0/2877731674 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7ec01dd70 con 0x7fd7f810fe70 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.009+0000 7fd7df7fe6c0 1 -- 10.20.193.40:0/2877731674 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd7ec009030 con 0x7fd7f810fe70 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.009+0000 7fd7df7fe6c0 1 -- 10.20.193.40:0/2877731674 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7ec007650 con 0x7fd7f810fe70 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.009+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f80f99e0 con 0x7fd7f810fe70 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.009+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f80f9e70 con 0x7fd7f810fe70 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.010+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f8175590 con 0x7fd7f810fe70 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.015+0000 7fd7df7fe6c0 1 -- 10.20.193.40:0/2877731674 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fd7ec005340 con 0x7fd7f810fe70 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.017+0000 7fd7df7fe6c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7c803f940 0x7fd7c805fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.017+0000 7fd7df7fe6c0 1 -- 10.20.193.40:0/2877731674 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fd7ec062850 con 0x7fd7f810fe70 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.018+0000 7fd7df7fe6c0 1 -- 10.20.193.40:0/2877731674 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd7ec024030 con 0x7fd7f810fe70 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.018+0000 7fd7f65756c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7c803f940 0x7fd7c805fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.019+0000 7fd7f65756c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7c803f940 0x7fd7c805fdf0 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7e0004750 tx=0x7fd7e0005e50 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.140 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial040') 2026-02-13T01:21:39.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.136+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/176980035 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b7c50 msgr2=0x7f3a240b80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.136+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/176980035 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b7c50 0x7f3a240b80c0 secure :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=9308372211487804510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a20009970 tx=0x7f3a2002ed20 comp rx=0 tx=0).stop 2026-02-13T01:21:39.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.136+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/176980035 shutdown_connections 2026-02-13T01:21:39.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.136+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/176980035 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3a240b8600 0x7f3a24118f90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.136+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/176980035 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b7c50 0x7f3a240b80c0 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=9308372211487804510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.138+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/176980035 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3a240b6ad0 0x7f3a240b6ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.138+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/176980035 >> 10.20.193.40:0/176980035 conn(0x7f3a240941f0 msgr2=0x7f3a240b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.138+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/176980035 shutdown_connections 2026-02-13T01:21:39.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.138+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/176980035 wait complete. 2026-02-13T01:21:39.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.139+0000 7f3a2b5776c0 1 Processor -- start 2026-02-13T01:21:39.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.139+0000 7f3a2b5776c0 1 -- start start 2026-02-13T01:21:39.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.139+0000 7f3a2b5776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b6ad0 0x7f3a240b9f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.139+0000 7f3a2b5776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3a240b7c50 0x7f3a240ba5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a2a5756c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b6ad0 0x7f3a240b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a29d746c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3a240b7c50 0x7f3a240ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a2a5756c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b6ad0 0x7f3a240b9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:45958/0 (socket says 10.20.193.40:45958) 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a29d746c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3a240b7c50 0x7f3a240ba5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47882/0 (socket says 10.20.193.40:47882) 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a2a5756c0 1 -- 10.20.193.40:0/1219374209 learned_addr learned my addr 10.20.193.40:0/1219374209 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3a240b8600 0x7f3a240bb1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240bb940 con 0x7f3a240b7c50 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240bbab0 con 0x7f3a240b8600 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a2ad766c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3a240b8600 0x7f3a240bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.140+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240bbc70 con 0x7f3a240b6ad0 2026-02-13T01:21:39.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.141+0000 7f3a29d746c0 1 -- 10.20.193.40:0/1219374209 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b6ad0 msgr2=0x7f3a240b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.141+0000 7f3a29d746c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b6ad0 0x7f3a240b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.141+0000 7f3a2a5756c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b6ad0 0x7f3a240b9f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:21:39.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.142+0000 7f3a29d746c0 1 -- 10.20.193.40:0/1219374209 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3a240b8600 msgr2=0x7f3a240bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.142+0000 7f3a29d746c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3a240b8600 0x7f3a240bb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.142+0000 7f3a29d746c0 1 -- 10.20.193.40:0/1219374209 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c00a5b0 con 0x7f3a240b7c50 2026-02-13T01:21:39.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.143+0000 7f3a2ad766c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3a240b8600 0x7f3a240bb1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:21:39.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.143+0000 7f3a29d746c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3a240b7c50 0x7f3a240ba5c0 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a20007320 tx=0x7f3a2002f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.146+0000 7f3a0f7fe6c0 1 -- 10.20.193.40:0/1219374209 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a20002b60 con 0x7f3a240b7c50 2026-02-13T01:21:39.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.146+0000 7f3a0f7fe6c0 1 -- 10.20.193.40:0/1219374209 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3a20002cc0 con 0x7f3a240b7c50 2026-02-13T01:21:39.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.146+0000 7f3a0f7fe6c0 1 -- 10.20.193.40:0/1219374209 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a20031700 con 0x7f3a240b7c50 2026-02-13T01:21:39.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.146+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a180094c0 con 0x7f3a240b7c50 2026-02-13T01:21:39.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.146+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a20009590 con 0x7f3a240b7c50 2026-02-13T01:21:39.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.147+0000 7f3a0f7fe6c0 1 -- 10.20.193.40:0/1219374209 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f3a20031890 con 0x7f3a240b7c50 2026-02-13T01:21:39.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.147+0000 7f3a0f7fe6c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3a0803f940 0x7f3a0805fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.147+0000 7f3a0f7fe6c0 1 -- 10.20.193.40:0/1219374209 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f3a20075680 con 0x7f3a240b7c50 2026-02-13T01:21:39.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.148+0000 7f3a2a5756c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3a0803f940 0x7f3a0805fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.151+0000 7f3a2a5756c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3a0803f940 0x7f3a0805fdf0 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1c00a580 tx=0x7f3a1c00a310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.169+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fd7f8174c30 con 0x7fd7f810fe70 2026-02-13T01:21:39.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.171+0000 7f1540a506c0 1 -- 10.20.193.40:0/3175473868 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f153c155340 msgr2=0x7f153c1757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.171+0000 7f1540a506c0 1 --2- 10.20.193.40:0/3175473868 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f153c155340 0x7f153c1757f0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=17679058897400050414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1530006fd0 tx=0x7f153002fd20 comp rx=0 tx=0).stop 2026-02-13T01:21:39.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.172+0000 7f1540a506c0 1 -- 10.20.193.40:0/3175473868 shutdown_connections 2026-02-13T01:21:39.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.172+0000 7f1540a506c0 1 --2- 10.20.193.40:0/3175473868 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f153c155340 0x7f153c1757f0 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=17679058897400050414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.172+0000 7f1540a506c0 1 --2- 10.20.193.40:0/3175473868 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f153c1347c0 0x7f153c154c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.172+0000 7f1540a506c0 1 --2- 10.20.193.40:0/3175473868 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f153c113dc0 0x7f153c1341a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.172+0000 7f1540a506c0 1 -- 10.20.193.40:0/3175473868 >> 10.20.193.40:0/3175473868 conn(0x7f153c05b720 msgr2=0x7f153c05bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.172+0000 7f1540a506c0 1 -- 10.20.193.40:0/3175473868 shutdown_connections 2026-02-13T01:21:39.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.172+0000 7f1540a506c0 1 -- 10.20.193.40:0/3175473868 wait complete. 2026-02-13T01:21:39.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.173+0000 7f1540a506c0 1 Processor -- start 2026-02-13T01:21:39.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.174+0000 7fd7df7fe6c0 1 -- 10.20.193.40:0/2877731674 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v21)=0 v21) ==== 119+0+0 (secure 0 0 0) 0x7fd7ec024210 con 0x7fd7f810fe70 2026-02-13T01:21:39.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.174+0000 7f1540a506c0 1 -- start start 2026-02-13T01:21:39.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f1540a506c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f153c113dc0 0x7f153c154ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f1540a506c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f153c1347c0 0x7f153c175770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f0005310 con 0x7f3a240b7c50 2026-02-13T01:21:39.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f153b7fe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f153c113dc0 0x7f153c154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f153b7fe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f153c113dc0 0x7f153c154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43534/0 (socket says 10.20.193.40:43534) 2026-02-13T01:21:39.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f153b7fe6c0 1 -- 10.20.193.40:0/1901022204 learned_addr learned my addr 10.20.193.40:0/1901022204 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f1540a506c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f153c155340 0x7f153c0ff7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f153c0fff70 con 0x7f153c1347c0 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f153c1000e0 con 0x7f153c113dc0 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.175+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f153c1007e0 con 0x7f153c155340 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.176+0000 7f153affd6c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f153c1347c0 0x7f153c175770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.176+0000 7f153bfff6c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f153c155340 0x7f153c0ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.176+0000 7f153b7fe6c0 1 -- 10.20.193.40:0/1901022204 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f153c155340 msgr2=0x7f153c0ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.176+0000 7f153b7fe6c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f153c155340 0x7f153c0ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.176+0000 7f153b7fe6c0 1 -- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f153c1347c0 msgr2=0x7f153c175770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.176+0000 7f153b7fe6c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f153c1347c0 0x7f153c175770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.176+0000 7f153b7fe6c0 1 -- 10.20.193.40:0/1901022204 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15280081d0 con 0x7f153c113dc0 2026-02-13T01:21:39.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.176+0000 7f153bfff6c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f153c155340 0x7f153c0ff7e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:39.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.176+0000 7f153affd6c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f153c1347c0 0x7f153c175770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:39.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.177+0000 7f153b7fe6c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f153c113dc0 0x7f153c154ba0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1528004750 tx=0x7f152800be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.177+0000 7f1538ff96c0 1 -- 10.20.193.40:0/1901022204 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1528004030 con 0x7f153c113dc0 2026-02-13T01:21:39.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.177+0000 7f1538ff96c0 1 -- 10.20.193.40:0/1901022204 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f15280026b0 con 0x7f153c113dc0 2026-02-13T01:21:39.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.177+0000 7f1538ff96c0 1 -- 10.20.193.40:0/1901022204 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f152800cd20 con 0x7f153c113dc0 2026-02-13T01:21:39.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.177+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153000a5b0 con 0x7f153c113dc0 2026-02-13T01:21:39.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.177+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f153c100d90 con 0x7f153c113dc0 2026-02-13T01:21:39.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.180+0000 7f3a0f7fe6c0 1 -- 10.20.193.40:0/1219374209 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3a2002fd20 con 0x7f3a240b7c50 2026-02-13T01:21:39.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.181+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1500005310 con 0x7f153c113dc0 2026-02-13T01:21:39.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.181+0000 7f1538ff96c0 1 -- 10.20.193.40:0/1901022204 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f1528004190 con 0x7f153c113dc0 2026-02-13T01:21:39.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.182+0000 7f1538ff96c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f151003f940 0x7f151005fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.182+0000 7f153affd6c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f151003f940 0x7f151005fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.182+0000 7f1538ff96c0 1 -- 10.20.193.40:0/1901022204 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f1528051660 con 0x7f153c113dc0 2026-02-13T01:21:39.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.185+0000 7f1538ff96c0 1 -- 10.20.193.40:0/1901022204 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1528005020 con 0x7f153c113dc0 2026-02-13T01:21:39.191 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.186+0000 7f153affd6c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f151003f940 0x7f151005fdf0 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f152c004750 tx=0x7f152c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7c803f940 msgr2=0x7fd7c805fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7c803f940 0x7fd7c805fdf0 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7e0004750 tx=0x7fd7e0005e50 comp rx=0 tx=0).stop 2026-02-13T01:21:39.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7f810fe70 msgr2=0x7fd7f8171190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7f810fe70 0x7fd7f8171190 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7ec009490 tx=0x7fd7ec00bca0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 shutdown_connections 2026-02-13T01:21:39.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7c803f940 0x7fd7c805fdf0 unknown :-1 s=CLOSED pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7f8110820 0x7fd7f80f8870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7f810fe70 0x7fd7f8171190 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 --2- 10.20.193.40:0/2877731674 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7f810ecf0 0x7fd7f80f8030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 >> 10.20.193.40:0/2877731674 conn(0x7fd7f80ec410 msgr2=0x7fd7f80ee120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 shutdown_connections 2026-02-13T01:21:39.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.206+0000 7fd7f75776c0 1 -- 10.20.193.40:0/2877731674 wait complete. 2026-02-13T01:21:39.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:38 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:38 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:38 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:38 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:38 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:38 trial055 ceph-mon[27509]: mgrmap e12: x(active, since 2s) 2026-02-13T01:21:39.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:38 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:38 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3361750910' entity='client.admin' 2026-02-13T01:21:39.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:38 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.250+0000 7ffa92a306c0 1 -- 10.20.193.40:0/3511444755 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 msgr2=0x7ffa8c1104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.250+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/3511444755 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 0x7ffa8c1104b0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=15226643966772790465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa7c009bd0 tx=0x7ffa7c02efb0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.251+0000 7ffa92a306c0 1 -- 10.20.193.40:0/3511444755 shutdown_connections 2026-02-13T01:21:39.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.251+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/3511444755 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa8c1109f0 0x7ffa8c171380 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.251+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/3511444755 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 0x7ffa8c1104b0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=15226643966772790465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.251+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/3511444755 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa8c10eec0 0x7ffa8c10f2b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.251+0000 7ffa92a306c0 1 -- 10.20.193.40:0/3511444755 >> 10.20.193.40:0/3511444755 conn(0x7ffa8c0ec5c0 msgr2=0x7ffa8c10c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.251+0000 7ffa92a306c0 1 -- 10.20.193.40:0/3511444755 shutdown_connections 2026-02-13T01:21:39.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:38 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:38 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:38 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:38 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:38 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:38 trial118 ceph-mon[27812]: mgrmap e12: x(active, since 2s) 2026-02-13T01:21:39.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:38 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:38 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3361750910' entity='client.admin' 2026-02-13T01:21:39.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:38 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:39.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.251+0000 7ffa92a306c0 1 -- 10.20.193.40:0/3511444755 wait complete. 2026-02-13T01:21:39.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.252+0000 7ffa92a306c0 1 Processor -- start 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.252+0000 7ffa92a306c0 1 -- start start 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.253+0000 7ffa92a306c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa8c10eec0 0x7ffa8c0ee680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.253+0000 7ffa92a306c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 0x7ffa8c171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.253+0000 7ffa92a306c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa8c1109f0 0x7ffa8c0eeee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.253+0000 7ffa92a306c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c0efac0 con 0x7ffa8c110040 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.253+0000 7ffa92a306c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c0efc30 con 0x7ffa8c10eec0 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.254+0000 7ffa92a306c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c0efdf0 con 0x7ffa8c1109f0 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.254+0000 7ffa90fa26c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa8c1109f0 0x7ffa8c0eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.254+0000 7ffa8b7fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 0x7ffa8c171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.254+0000 7ffa8b7fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 0x7ffa8c171380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47934/0 (socket says 10.20.193.40:47934) 2026-02-13T01:21:39.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.254+0000 7ffa8b7fe6c0 1 -- 10.20.193.40:0/1540670752 learned_addr learned my addr 10.20.193.40:0/1540670752 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.254+0000 7ffa8b7fe6c0 1 -- 10.20.193.40:0/1540670752 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa8c1109f0 msgr2=0x7ffa8c0eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7ffa8b7fe6c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa8c1109f0 0x7ffa8c0eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7ffa8b7fe6c0 1 -- 10.20.193.40:0/1540670752 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa8c10eec0 msgr2=0x7ffa8c0ee680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:21:39.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7ffa8b7fe6c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa8c10eec0 0x7ffa8c0ee680 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7ffa8b7fe6c0 1 -- 10.20.193.40:0/1540670752 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c009590 con 0x7ffa8c110040 2026-02-13T01:21:39.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7ffa8b7fe6c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 0x7ffa8c171380 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa7c02f4c0 tx=0x7ffa7c004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7ffa897fa6c0 1 -- 10.20.193.40:0/1540670752 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa7c02faf0 con 0x7ffa8c110040 2026-02-13T01:21:39.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.256+0000 7ffa897fa6c0 1 -- 10.20.193.40:0/1540670752 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ffa7c02fc50 con 0x7ffa8c110040 2026-02-13T01:21:39.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.256+0000 7ffa897fa6c0 1 -- 10.20.193.40:0/1540670752 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa7c037660 con 0x7ffa8c110040 2026-02-13T01:21:39.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.256+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8c0f0070 con 0x7ffa8c110040 2026-02-13T01:21:39.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.256+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8c0f0520 con 0x7ffa8c110040 2026-02-13T01:21:39.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.254+0000 7f2af75776c0 1 -- 10.20.193.40:0/1306014413 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af805e390 msgr2=0x7f2af8113dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.254+0000 7f2af75776c0 1 --2- 10.20.193.40:0/1306014413 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af805e390 0x7f2af8113dc0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=2219055627794983871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aec009970 tx=0x7f2aec02ed20 comp rx=0 tx=0).stop 2026-02-13T01:21:39.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7f2af75776c0 1 -- 10.20.193.40:0/1306014413 shutdown_connections 2026-02-13T01:21:39.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7f2af75776c0 1 --2- 10.20.193.40:0/1306014413 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2af8114ec0 0x7f2af8115360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7f2af75776c0 1 --2- 10.20.193.40:0/1306014413 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2af8114350 0x7f2af81147a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7f2af75776c0 1 --2- 10.20.193.40:0/1306014413 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af805e390 0x7f2af8113dc0 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=2219055627794983871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7f2af75776c0 1 -- 10.20.193.40:0/1306014413 >> 10.20.193.40:0/1306014413 conn(0x7f2af805bb70 msgr2=0x7f2af805bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7f2af75776c0 1 -- 10.20.193.40:0/1306014413 shutdown_connections 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.255+0000 7f2af75776c0 1 -- 10.20.193.40:0/1306014413 wait complete. 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.257+0000 7f2af75776c0 1 Processor -- start 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.257+0000 7f2af75776c0 1 -- start start 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af75776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2af805e390 0x7f2af80fdf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af75776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af8114350 0x7f2af80fe580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af75776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2af8114ec0 0x7f2af80ff170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af75776c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2af80ff900 con 0x7f2af805e390 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af75776c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2af80ffa70 con 0x7f2af8114ec0 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af75776c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2af80ffc30 con 0x7f2af8114350 2026-02-13T01:21:39.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af5d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af8114350 0x7f2af80fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af5d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af8114350 0x7f2af80fe580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:46012/0 (socket says 10.20.193.40:46012) 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af5d746c0 1 -- 10.20.193.40:0/1681754077 learned_addr learned my addr 10.20.193.40:0/1681754077 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.258+0000 7f2af6d766c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2af8114ec0 0x7f2af80ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.259+0000 7f2af5d746c0 1 -- 10.20.193.40:0/1681754077 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2af8114ec0 msgr2=0x7f2af80ff170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.259+0000 7f2af5d746c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2af8114ec0 0x7f2af80ff170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.259+0000 7f2af5d746c0 1 -- 10.20.193.40:0/1681754077 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2af805e390 msgr2=0x7f2af80fdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.259+0000 7f2af5d746c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2af805e390 0x7f2af80fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.259+0000 7f2af5d746c0 1 -- 10.20.193.40:0/1681754077 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec009590 con 0x7f2af8114350 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.261+0000 7f2af5d746c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af8114350 0x7f2af80fe580 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ae000b6c0 tx=0x7f2ae000bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.261+0000 7f2adf7fe6c0 1 -- 10.20.193.40:0/1681754077 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ae00044a0 con 0x7f2af8114350 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.261+0000 7f2adf7fe6c0 1 -- 10.20.193.40:0/1681754077 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2ae000be50 con 0x7f2af8114350 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.262+0000 7f2adf7fe6c0 1 -- 10.20.193.40:0/1681754077 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ae000e070 con 0x7f2af8114350 2026-02-13T01:21:39.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.262+0000 7f2af75776c0 1 -- 10.20.193.40:0/1681754077 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af80fff10 con 0x7f2af8114350 2026-02-13T01:21:39.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.262+0000 7f2af75776c0 1 -- 10.20.193.40:0/1681754077 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af8100450 con 0x7f2af8114350 2026-02-13T01:21:39.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.257+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa60005310 con 0x7ffa8c110040 2026-02-13T01:21:39.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.264+0000 7ffa897fa6c0 1 -- 10.20.193.40:0/1540670752 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7ffa7c0377f0 con 0x7ffa8c110040 2026-02-13T01:21:39.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.265+0000 7ffa897fa6c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa6803f940 0x7ffa6805fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.265+0000 7ffa897fa6c0 1 -- 10.20.193.40:0/1540670752 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7ffa7c076a80 con 0x7ffa8c110040 2026-02-13T01:21:39.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.265+0000 7ffa897fa6c0 1 -- 10.20.193.40:0/1540670752 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffa7c076e30 con 0x7ffa8c110040 2026-02-13T01:21:39.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.266+0000 7ffa8bfff6c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa6803f940 0x7ffa6805fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.265+0000 7fa1d9ffb6c0 1 -- 10.20.193.40:0/363509146 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1cc005560 con 0x7fa1d40b8600 2026-02-13T01:21:39.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.266+0000 7ffa8bfff6c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa6803f940 0x7ffa6805fdf0 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa78004770 tx=0x7ffa78006c90 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7f2add7fa6c0 1 -- 10.20.193.40:0/1681754077 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2abc005310 con 0x7f2af8114350 2026-02-13T01:21:39.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/363509146 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1d40b8600 msgr2=0x7fa1d4118f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/363509146 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1d40b8600 0x7fa1d4118f90 secure :-1 s=READY pgs=18 gs=3 cs=0 l=1 c_cookie=6428763466133370173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1cc006fd0 tx=0x7fa1cc02fd20 comp rx=0 tx=0).stop 2026-02-13T01:21:39.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/363509146 shutdown_connections 2026-02-13T01:21:39.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/363509146 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1d40b8600 0x7fa1d4118f90 unknown :-1 s=CLOSED pgs=18 gs=3 cs=0 l=1 c_cookie=6428763466133370173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/363509146 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1d40b7c50 0x7fa1d40b80c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/363509146 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1d40b6ad0 0x7fa1d40b6ec0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/363509146 >> 10.20.193.40:0/363509146 conn(0x7fa1d40941f0 msgr2=0x7fa1d40b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7f2adf7fe6c0 1 -- 10.20.193.40:0/1681754077 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f2ae00026b0 con 0x7f2af8114350 2026-02-13T01:21:39.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/363509146 shutdown_connections 2026-02-13T01:21:39.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.267+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/363509146 wait complete. 2026-02-13T01:21:39.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.268+0000 7f2adf7fe6c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ad003f940 0x7f2ad005fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.269+0000 7fa1dbfff6c0 1 Processor -- start 2026-02-13T01:21:39.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.268+0000 7f2adf7fe6c0 1 -- 10.20.193.40:0/1681754077 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2ae0051160 con 0x7f2af8114350 2026-02-13T01:21:39.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.269+0000 7f2af65756c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ad003f940 0x7f2ad005fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.269+0000 7fa1dbfff6c0 1 -- start start 2026-02-13T01:21:39.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.270+0000 7fa1dbfff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1d40b6ad0 0x7fa1d4009240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.270+0000 7fa1dbfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1d40b7c50 0x7fa1d4118f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.270+0000 7fa1dbfff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1d40b8600 0x7fa1d4009a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.270+0000 7fa1dbfff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d400a6d0 con 0x7fa1d40b8600 2026-02-13T01:21:39.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.270+0000 7fa1dbfff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d400a840 con 0x7fa1d40b7c50 2026-02-13T01:21:39.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.270+0000 7fa1dbfff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d400aa00 con 0x7fa1d40b6ad0 2026-02-13T01:21:39.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.271+0000 7f2af65756c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ad003f940 0x7f2ad005fdf0 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aec005b40 tx=0x7f2aec005fd0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.271+0000 7fa1daffd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1d40b6ad0 0x7fa1d4009240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.271+0000 7fa1da7fc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1d40b7c50 0x7fa1d4118f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.271+0000 7fa1da7fc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1d40b7c50 0x7fa1d4118f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43590/0 (socket says 10.20.193.40:43590) 2026-02-13T01:21:39.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.271+0000 7f2adf7fe6c0 1 -- 10.20.193.40:0/1681754077 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2ae00128c0 con 0x7f2af8114350 2026-02-13T01:21:39.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.271+0000 7fa1da7fc6c0 1 -- 10.20.193.40:0/1301685980 learned_addr learned my addr 10.20.193.40:0/1301685980 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.272+0000 7fa1db7fe6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1d40b8600 0x7fa1d4009a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.272+0000 7fa1da7fc6c0 1 -- 10.20.193.40:0/1301685980 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1d40b6ad0 msgr2=0x7fa1d4009240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.272+0000 7fa1da7fc6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1d40b6ad0 0x7fa1d4009240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.272+0000 7fa1da7fc6c0 1 -- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1d40b8600 msgr2=0x7fa1d4009a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.272+0000 7fa1da7fc6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1d40b8600 0x7fa1d4009a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.274+0000 7fa1da7fc6c0 1 -- 10.20.193.40:0/1301685980 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d0009590 con 0x7fa1d40b7c50 2026-02-13T01:21:39.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.281+0000 7fa1db7fe6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1d40b8600 0x7fa1d4009a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:39.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.282+0000 7fa1da7fc6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1d40b7c50 0x7fa1d4118f70 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1c40092e0 tx=0x7fa1c400bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.282+0000 7fa1bbfff6c0 1 -- 10.20.193.40:0/1301685980 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1c4004250 con 0x7fa1d40b7c50 2026-02-13T01:21:39.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.282+0000 7fa1bbfff6c0 1 -- 10.20.193.40:0/1301685980 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa1c40043b0 con 0x7fa1d40b7c50 2026-02-13T01:21:39.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.283+0000 7fa1bbfff6c0 1 -- 10.20.193.40:0/1301685980 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1c40072a0 con 0x7fa1d40b7c50 2026-02-13T01:21:39.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.283+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1cc00a5b0 con 0x7fa1d40b7c50 2026-02-13T01:21:39.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.283+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d400af50 con 0x7fa1d40b7c50 2026-02-13T01:21:39.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.284+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d411d230 con 0x7fa1d40b7c50 2026-02-13T01:21:39.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.292+0000 7fa1bbfff6c0 1 -- 10.20.193.40:0/1301685980 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fa1c400c4d0 con 0x7fa1d40b7c50 2026-02-13T01:21:39.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.294+0000 7fa1bbfff6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1a803f910 0x7fa1a805fdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.294+0000 7fa1bbfff6c0 1 -- 10.20.193.40:0/1301685980 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fa1c4051280 con 0x7fa1d40b7c50 2026-02-13T01:21:39.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.299+0000 7fa1bbfff6c0 1 -- 10.20.193.40:0/1301685980 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa1c4007400 con 0x7fa1d40b7c50 2026-02-13T01:21:39.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.315+0000 7fa1daffd6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1a803f910 0x7fa1a805fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.320+0000 7fa1daffd6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1a803f910 0x7fa1a805fdc0 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1d0005b40 tx=0x7fa1d0009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.352+0000 7fcb63b346c0 1 -- 10.20.193.40:0/1530272690 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcb5c1554e0 msgr2=0x7fcb5c175990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.352+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/1530272690 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcb5c1554e0 0x7fcb5c175990 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=12669164150593884060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb4c009bd0 tx=0x7fcb4c02efb0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.352+0000 7fcb63b346c0 1 -- 10.20.193.40:0/1530272690 shutdown_connections 2026-02-13T01:21:39.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.352+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/1530272690 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcb5c1554e0 0x7fcb5c175990 unknown :-1 s=CLOSED pgs=105 gs=3 cs=0 l=1 c_cookie=12669164150593884060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.352+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/1530272690 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcb5c134920 0x7fcb5c154da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.352+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/1530272690 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcb5c113f70 0x7fcb5c134350 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.352+0000 7fcb63b346c0 1 -- 10.20.193.40:0/1530272690 >> 10.20.193.40:0/1530272690 conn(0x7fcb5c05b8e0 msgr2=0x7fcb5c05bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.352+0000 7fcb63b346c0 1 -- 10.20.193.40:0/1530272690 shutdown_connections 2026-02-13T01:21:39.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.352+0000 7fcb63b346c0 1 -- 10.20.193.40:0/1530272690 wait complete. 2026-02-13T01:21:39.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.353+0000 7fcb63b346c0 1 Processor -- start 2026-02-13T01:21:39.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.354+0000 7fcb63b346c0 1 -- start start 2026-02-13T01:21:39.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.354+0000 7fcb63b346c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcb5c113f70 0x7fcb5c154d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb63b346c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcb5c134920 0x7fcb5c1758c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb63b346c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcb5c1554e0 0x7fcb5c11c400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb63b346c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c11cb90 con 0x7fcb5c1554e0 2026-02-13T01:21:39.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb63b346c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c11cd00 con 0x7fcb5c134920 2026-02-13T01:21:39.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb63b346c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c11d400 con 0x7fcb5c113f70 2026-02-13T01:21:39.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb618a96c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcb5c113f70 0x7fcb5c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb610a86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcb5c134920 0x7fcb5c1758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb618a96c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcb5c113f70 0x7fcb5c154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:46044/0 (socket says 10.20.193.40:46044) 2026-02-13T01:21:39.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb620aa6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcb5c1554e0 0x7fcb5c11c400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.355+0000 7fcb618a96c0 1 -- 10.20.193.40:0/4166734875 learned_addr learned my addr 10.20.193.40:0/4166734875 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.360+0000 7fcb620aa6c0 1 -- 10.20.193.40:0/4166734875 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcb5c113f70 msgr2=0x7fcb5c154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.360+0000 7fcb620aa6c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcb5c113f70 0x7fcb5c154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.360+0000 7fcb620aa6c0 1 -- 10.20.193.40:0/4166734875 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcb5c134920 msgr2=0x7fcb5c1758c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.360+0000 7fcb620aa6c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcb5c134920 0x7fcb5c1758c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.360+0000 7fcb620aa6c0 1 -- 10.20.193.40:0/4166734875 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c009590 con 0x7fcb5c1554e0 2026-02-13T01:21:39.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.363+0000 7fcb620aa6c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcb5c1554e0 0x7fcb5c11c400 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb4c009bd0 tx=0x7fcb4c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.365+0000 7fcb4affd6c0 1 -- 10.20.193.40:0/4166734875 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb4c02fa30 con 0x7fcb5c1554e0 2026-02-13T01:21:39.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.367+0000 7fcb4affd6c0 1 -- 10.20.193.40:0/4166734875 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fcb4c02fb90 con 0x7fcb5c1554e0 2026-02-13T01:21:39.369 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.367+0000 7fcb4affd6c0 1 -- 10.20.193.40:0/4166734875 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb4c037630 con 0x7fcb5c1554e0 2026-02-13T01:21:39.369 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.367+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5c11d680 con 0x7fcb5c1554e0 2026-02-13T01:21:39.372 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.370+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5c11dab0 con 0x7fcb5c1554e0 2026-02-13T01:21:39.375 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.374+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5c1799c0 con 0x7fcb5c1554e0 2026-02-13T01:21:39.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.374+0000 7fcb4affd6c0 1 -- 10.20.193.40:0/4166734875 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fcb4c02fd00 con 0x7fcb5c1554e0 2026-02-13T01:21:39.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.388+0000 7fcb4affd6c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb3803f990 0x7fcb3805fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.388+0000 7fcb4affd6c0 1 -- 10.20.193.40:0/4166734875 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fcb4c075880 con 0x7fcb5c1554e0 2026-02-13T01:21:39.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.389+0000 7fcb4affd6c0 1 -- 10.20.193.40:0/4166734875 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcb4c077da0 con 0x7fcb5c1554e0 2026-02-13T01:21:39.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.422+0000 7fcb618a96c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb3803f990 0x7fcb3805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.423+0000 7fcb618a96c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb3803f990 0x7fcb3805fe40 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb58006b60 tx=0x7fcb58006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.470 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.459+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ffa580051d0 con 0x7ffa8c110040 2026-02-13T01:21:39.485 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.483+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f1500005b40 con 0x7f153c113dc0 2026-02-13T01:21:39.489 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.488+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/3383700757 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc9e80c5970 msgr2=0x7fc9e8126300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.488+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/3383700757 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc9e80c5970 0x7fc9e8126300 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=17343314821794146735 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9e0006fd0 tx=0x7fc9e002fd70 comp rx=0 tx=0).stop 2026-02-13T01:21:39.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.488+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/3383700757 shutdown_connections 2026-02-13T01:21:39.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.488+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/3383700757 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc9e80c5970 0x7fc9e8126300 unknown :-1 s=CLOSED pgs=107 gs=2 cs=0 l=1 c_cookie=17343314821794146735 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.488+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/3383700757 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc9e80c4fc0 0x7fc9e80c5430 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.488+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/3383700757 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc9e80c3e40 0x7fc9e80c4230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.488+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/3383700757 >> 10.20.193.40:0/3383700757 conn(0x7fc9e80a10e0 msgr2=0x7fc9e80c1510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.488+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/3383700757 shutdown_connections 2026-02-13T01:21:39.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.488+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/3383700757 wait complete. 2026-02-13T01:21:39.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.489+0000 7fc9ef5776c0 1 Processor -- start 2026-02-13T01:21:39.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.489+0000 7fc9ef5776c0 1 -- start start 2026-02-13T01:21:39.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.490+0000 7fc9ef5776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc9e80c3e40 0x7fc9e80acdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.490+0000 7fc9ef5776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc9e80c4fc0 0x7fc9e80ad440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.490+0000 7fc9ef5776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc9e80c5970 0x7fc9e80ae030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.491+0000 7fc9ef5776c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e80ae7c0 con 0x7fc9e80c4fc0 2026-02-13T01:21:39.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.491+0000 7fc9ef5776c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e80ae930 con 0x7fc9e80c5970 2026-02-13T01:21:39.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.491+0000 7fc9ef5776c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e80aeaf0 con 0x7fc9e80c3e40 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.491+0000 7fc9eed766c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc9e80c5970 0x7fc9e80ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.491+0000 7fc9ee5756c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc9e80c3e40 0x7fc9e80acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.491+0000 7fc9eed766c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc9e80c5970 0x7fc9e80ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43638/0 (socket says 10.20.193.40:43638) 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.491+0000 7fc9eed766c0 1 -- 10.20.193.40:0/588878271 learned_addr learned my addr 10.20.193.40:0/588878271 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.491+0000 7fc9edd746c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc9e80c4fc0 0x7fc9e80ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.492+0000 7fc9eed766c0 1 -- 10.20.193.40:0/588878271 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc9e80c3e40 msgr2=0x7fc9e80acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.492+0000 7fc9eed766c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc9e80c3e40 0x7fc9e80acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.492+0000 7fc9eed766c0 1 -- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc9e80c4fc0 msgr2=0x7fc9e80ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.492+0000 7fc9eed766c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc9e80c4fc0 0x7fc9e80ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.492+0000 7fc9eed766c0 1 -- 10.20.193.40:0/588878271 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e000a5b0 con 0x7fc9e80c5970 2026-02-13T01:21:39.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.492+0000 7fc9edd746c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc9e80c4fc0 0x7fc9e80ad440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:21:39.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.492+0000 7fc9ee5756c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc9e80c3e40 0x7fc9e80acdf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:39.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.493+0000 7fc9eed766c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc9e80c5970 0x7fc9e80ae030 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9e000a2e0 tx=0x7fc9e0030800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.493+0000 7fc9e77fe6c0 1 -- 10.20.193.40:0/588878271 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9e0005b00 con 0x7fc9e80c5970 2026-02-13T01:21:39.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.493+0000 7fc9e77fe6c0 1 -- 10.20.193.40:0/588878271 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc9e0003d40 con 0x7fc9e80c5970 2026-02-13T01:21:39.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.493+0000 7fc9e77fe6c0 1 -- 10.20.193.40:0/588878271 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9e00088f0 con 0x7fc9e80c5970 2026-02-13T01:21:39.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.493+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e80aed70 con 0x7fc9e80c5970 2026-02-13T01:21:39.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.493+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e80c64e0 con 0x7fc9e80c5970 2026-02-13T01:21:39.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.495+0000 7fc9e77fe6c0 1 -- 10.20.193.40:0/588878271 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fc9e0006030 con 0x7fc9e80c5970 2026-02-13T01:21:39.498 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.482+0000 7fda997a06c0 1 -- 10.20.193.40:0/719444557 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda941137a0 msgr2=0x7fda94113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.498 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.482+0000 7fda997a06c0 1 --2- 10.20.193.40:0/719444557 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda941137a0 0x7fda94113b90 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=13265148408536558623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda8800aa40 tx=0x7fda8802fe00 comp rx=0 tx=0).stop 2026-02-13T01:21:39.498 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.482+0000 7fda997a06c0 1 -- 10.20.193.40:0/719444557 shutdown_connections 2026-02-13T01:21:39.498 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.482+0000 7fda997a06c0 1 --2- 10.20.193.40:0/719444557 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda94114cb0 0x7fda941757c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.498 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.482+0000 7fda997a06c0 1 --2- 10.20.193.40:0/719444557 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda94114120 0x7fda94114570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.498 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.482+0000 7fda997a06c0 1 --2- 10.20.193.40:0/719444557 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda941137a0 0x7fda94113b90 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=13265148408536558623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.498 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.482+0000 7fda997a06c0 1 -- 10.20.193.40:0/719444557 >> 10.20.193.40:0/719444557 conn(0x7fda94064120 msgr2=0x7fda94064540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.498 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.483+0000 7fda997a06c0 1 -- 10.20.193.40:0/719444557 shutdown_connections 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.483+0000 7fda997a06c0 1 -- 10.20.193.40:0/719444557 wait complete. 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.484+0000 7fda997a06c0 1 Processor -- start 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.484+0000 7fda997a06c0 1 -- start start 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.484+0000 7fda997a06c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda941137a0 0x7fda94118c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda997a06c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda94114120 0x7fda941192b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda997a06c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda94114cb0 0x7fda94119ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda997a06c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fda9411a630 con 0x7fda94114120 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda997a06c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fda9411a7a0 con 0x7fda94114cb0 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda997a06c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fda9411a960 con 0x7fda941137a0 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda93fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda941137a0 0x7fda94118c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda93fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda941137a0 0x7fda94118c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:46058/0 (socket says 10.20.193.40:46058) 2026-02-13T01:21:39.499 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda98f9f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda94114cb0 0x7fda94119ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda98f9f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda94114cb0 0x7fda94119ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:43628/0 (socket says 10.20.193.40:43628) 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda98f9f6c0 1 -- 10.20.193.40:0/1155008253 learned_addr learned my addr 10.20.193.40:0/1155008253 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.485+0000 7fda937fe6c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda94114120 0x7fda941192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda98f9f6c0 1 -- 10.20.193.40:0/1155008253 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda941137a0 msgr2=0x7fda94118c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda98f9f6c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda941137a0 0x7fda94118c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda98f9f6c0 1 -- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda94114120 msgr2=0x7fda941192b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda98f9f6c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda94114120 0x7fda941192b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda98f9f6c0 1 -- 10.20.193.40:0/1155008253 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8800a660 con 0x7fda94114cb0 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda937fe6c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda94114120 0x7fda941192b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda98f9f6c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda94114cb0 0x7fda94119ea0 secure :-1 s=READY pgs=19 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda80005fd0 tx=0x7fda8000bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.500 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda917fa6c0 1 -- 10.20.193.40:0/1155008253 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda80004280 con 0x7fda94114cb0 2026-02-13T01:21:39.501 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9411ac40 con 0x7fda94114cb0 2026-02-13T01:21:39.501 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda917fa6c0 1 -- 10.20.193.40:0/1155008253 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fda800043e0 con 0x7fda94114cb0 2026-02-13T01:21:39.501 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda917fa6c0 1 -- 10.20.193.40:0/1155008253 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda8000ce60 con 0x7fda94114cb0 2026-02-13T01:21:39.501 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.486+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9415b1a0 con 0x7fda94114cb0 2026-02-13T01:21:39.502 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.495+0000 7fc9e77fe6c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc9cc03f940 0x7fc9cc05fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.502 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.495+0000 7fc9e77fe6c0 1 -- 10.20.193.40:0/588878271 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fc9e0076960 con 0x7fc9e80c5970 2026-02-13T01:21:39.502 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.496+0000 7fc9ee5756c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc9cc03f940 0x7fc9cc05fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.502 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.498+0000 7fc9ee5756c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc9cc03f940 0x7fc9cc05fdf0 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9d8005fd0 tx=0x7fc9d80093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.502 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.499+0000 7ffa897fa6c0 1 -- 10.20.193.40:0/1540670752 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v22)=0 v22) ==== 120+0+0 (secure 0 0 0) 0x7ffa7c039920 con 0x7ffa8c110040 2026-02-13T01:21:39.502 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.487+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda941799a0 con 0x7fda94114cb0 2026-02-13T01:21:39.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa6803f940 msgr2=0x7ffa6805fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa6803f940 0x7ffa6805fdf0 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa78004770 tx=0x7ffa78006c90 comp rx=0 tx=0).stop 2026-02-13T01:21:39.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 msgr2=0x7ffa8c171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 0x7ffa8c171380 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa7c02f4c0 tx=0x7ffa7c004520 comp rx=0 tx=0).stop 2026-02-13T01:21:39.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 shutdown_connections 2026-02-13T01:21:39.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa6803f940 0x7ffa6805fdf0 unknown :-1 s=CLOSED pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa8c1109f0 0x7ffa8c0eeee0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa8c110040 0x7ffa8c171380 unknown :-1 s=CLOSED pgs=104 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 --2- 10.20.193.40:0/1540670752 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa8c10eec0 0x7ffa8c0ee680 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.505+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 >> 10.20.193.40:0/1540670752 conn(0x7ffa8c0ec5c0 msgr2=0x7ffa8c0632a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.506+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 shutdown_connections 2026-02-13T01:21:39.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.506+0000 7ffa92a306c0 1 -- 10.20.193.40:0/1540670752 wait complete. 2026-02-13T01:21:39.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.504+0000 7fda917fa6c0 1 -- 10.20.193.40:0/1155008253 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fda800048a0 con 0x7fda94114cb0 2026-02-13T01:21:39.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.504+0000 7fda917fa6c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda6803f930 0x7fda6805fde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.509 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.507+0000 7f1538ff96c0 1 -- 10.20.193.40:0/1901022204 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v23)=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f152800d040 con 0x7f153c113dc0 2026-02-13T01:21:39.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.516+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f151003f940 msgr2=0x7f151005fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.516+0000 7f1540a506c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f151003f940 0x7f151005fdf0 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f152c004750 tx=0x7f152c009260 comp rx=0 tx=0).stop 2026-02-13T01:21:39.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.516+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f153c113dc0 msgr2=0x7f153c154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.516+0000 7f1540a506c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f153c113dc0 0x7f153c154ba0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1528004750 tx=0x7f152800be10 comp rx=0 tx=0).stop 2026-02-13T01:21:39.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.518+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 shutdown_connections 2026-02-13T01:21:39.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.518+0000 7f1540a506c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f151003f940 0x7f151005fdf0 unknown :-1 s=CLOSED pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.518+0000 7f1540a506c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f153c155340 0x7f153c0ff7e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.518+0000 7f1540a506c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f153c1347c0 0x7f153c175770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.518+0000 7f1540a506c0 1 --2- 10.20.193.40:0/1901022204 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f153c113dc0 0x7f153c154ba0 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.518+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 >> 10.20.193.40:0/1901022204 conn(0x7f153c05b720 msgr2=0x7f153c0f60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.518+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 shutdown_connections 2026-02-13T01:21:39.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.518+0000 7f1540a506c0 1 -- 10.20.193.40:0/1901022204 wait complete. 2026-02-13T01:21:39.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.510+0000 7fda917fa6c0 1 -- 10.20.193.40:0/1155008253 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fda80024690 con 0x7fda94114cb0 2026-02-13T01:21:39.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.510+0000 7fda93fff6c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda6803f930 0x7fda6805fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.510+0000 7fda917fa6c0 1 -- 10.20.193.40:0/1155008253 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fda80002be0 con 0x7fda94114cb0 2026-02-13T01:21:39.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.511+0000 7fda93fff6c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda6803f930 0x7fda6805fde0 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda8800a990 tx=0x7fda88002470 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.545 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.544+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9bc005310 con 0x7fc9e80c5970 2026-02-13T01:21:39.550 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.546+0000 7fc9e77fe6c0 1 -- 10.20.193.40:0/588878271 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc9e0036660 con 0x7fc9e80c5970 2026-02-13T01:21:39.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.548+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fcb5c179b80 con 0x7fcb5c1554e0 2026-02-13T01:21:39.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.549+0000 7fcb4affd6c0 1 -- 10.20.193.40:0/4166734875 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v23)=0 v23) ==== 108+0+0 (secure 0 0 0) 0x7fcb4c037b90 con 0x7fcb5c1554e0 2026-02-13T01:21:39.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.558+0000 7f653b7fe6c0 1 -- 10.20.193.40:0/2819149634 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f652c004560 con 0x7f653c114d20 2026-02-13T01:21:39.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.558+0000 7f653bfff6c0 1 --2- 10.20.193.40:0/2819149634 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f653c114370 0x7f653c1147e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.558+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/2819149634 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f653c114d20 msgr2=0x7f653c1756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.558+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/2819149634 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f653c114d20 0x7f653c1756b0 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=9359909939569982499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f652c009970 tx=0x7f652c02ed70 comp rx=0 tx=0).stop 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.563+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/2819149634 shutdown_connections 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.563+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/2819149634 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f653c114d20 0x7f653c1756b0 unknown :-1 s=CLOSED pgs=20 gs=2 cs=0 l=1 c_cookie=9359909939569982499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.563+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/2819149634 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f653c114370 0x7f653c1147e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.563+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/2819149634 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f653c1131f0 0x7f653c1135e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.563+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/2819149634 >> 10.20.193.40:0/2819149634 conn(0x7f653c064140 msgr2=0x7f653c064540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.563+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/2819149634 shutdown_connections 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.563+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/2819149634 wait complete. 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.564+0000 7f6541c4f6c0 1 Processor -- start 2026-02-13T01:21:39.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.564+0000 7f6541c4f6c0 1 -- start start 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.565+0000 7f6541c4f6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f653c1131f0 0x7f653c118b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.565+0000 7f6541c4f6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f653c114370 0x7f653c1191e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.565+0000 7f6541c4f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f653c114d20 0x7f653c119dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.565+0000 7f6541c4f6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f653c11a560 con 0x7f653c1131f0 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.565+0000 7f6541c4f6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f653c11a6d0 con 0x7f653c114d20 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.565+0000 7f6541c4f6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f653c11a890 con 0x7f653c114370 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f653bfff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f653c114370 0x7f653c1191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f6540c4d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f653c1131f0 0x7f653c118b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f654144e6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f653c114d20 0x7f653c119dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f6540c4d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f653c1131f0 0x7f653c118b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48042/0 (socket says 10.20.193.40:48042) 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f6540c4d6c0 1 -- 10.20.193.40:0/4205904241 learned_addr learned my addr 10.20.193.40:0/4205904241 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f6540c4d6c0 1 -- 10.20.193.40:0/4205904241 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f653c114370 msgr2=0x7f653c1191e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f6540c4d6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f653c114370 0x7f653c1191e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f6540c4d6c0 1 -- 10.20.193.40:0/4205904241 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f653c114d20 msgr2=0x7f653c119dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f6540c4d6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f653c114d20 0x7f653c119dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f6540c4d6c0 1 -- 10.20.193.40:0/4205904241 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65280094c0 con 0x7f653c1131f0 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f654144e6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f653c114d20 0x7f653c119dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.566+0000 7f6540c4d6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f653c1131f0 0x7f653c118b90 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6530006e50 tx=0x7f653000d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.567+0000 7f6539ffb6c0 1 -- 10.20.193.40:0/4205904241 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f653000da70 con 0x7f653c1131f0 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.567+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c009590 con 0x7f653c1131f0 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.567+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c15b010 con 0x7f653c1131f0 2026-02-13T01:21:39.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.567+0000 7f6539ffb6c0 1 -- 10.20.193.40:0/4205904241 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f653000a070 con 0x7f653c1131f0 2026-02-13T01:21:39.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.567+0000 7f6539ffb6c0 1 -- 10.20.193.40:0/4205904241 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f653000da70 con 0x7f653c1131f0 2026-02-13T01:21:39.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.568+0000 7f6539ffb6c0 1 -- 10.20.193.40:0/4205904241 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f65300081c0 con 0x7f653c1131f0 2026-02-13T01:21:39.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.571+0000 7f6539ffb6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f651003f9a0 0x7f651005fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.571+0000 7f6539ffb6c0 1 -- 10.20.193.40:0/4205904241 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f65300532c0 con 0x7f653c1131f0 2026-02-13T01:21:39.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.571+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653c056250 con 0x7f653c1131f0 2026-02-13T01:21:39.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb3803f990 msgr2=0x7fcb3805fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb3803f990 0x7fcb3805fe40 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb58006b60 tx=0x7fcb58006af0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcb5c1554e0 msgr2=0x7fcb5c11c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcb5c1554e0 0x7fcb5c11c400 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb4c009bd0 tx=0x7fcb4c004360 comp rx=0 tx=0).stop 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 shutdown_connections 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fcb3803f990 0x7fcb3805fe40 unknown :-1 s=CLOSED pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcb5c1554e0 0x7fcb5c11c400 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcb5c134920 0x7fcb5c1758c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 --2- 10.20.193.40:0/4166734875 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcb5c113f70 0x7fcb5c154d70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 >> 10.20.193.40:0/4166734875 conn(0x7fcb5c05b8e0 msgr2=0x7fcb5c17ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.575+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 shutdown_connections 2026-02-13T01:21:39.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.574+0000 7f653bfff6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f651003f9a0 0x7f651005fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.575+0000 7f653bfff6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f651003f9a0 0x7f651005fe50 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6528004750 tx=0x7f6528009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.575+0000 7f6539ffb6c0 1 -- 10.20.193.40:0/4205904241 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f65300133f0 con 0x7f653c1131f0 2026-02-13T01:21:39.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.575+0000 7fcb63b346c0 1 -- 10.20.193.40:0/4166734875 wait complete. 2026-02-13T01:21:39.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.580+0000 7fb7396106c0 1 -- 10.20.193.40:0/1938764353 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb734118a20 msgr2=0x7fb734118e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.580+0000 7fb7396106c0 1 --2- 10.20.193.40:0/1938764353 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb734118a20 0x7fb734118e90 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=18089292447191035148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb71c009630 tx=0x7fb71c0379c0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.599+0000 7fb7396106c0 1 -- 10.20.193.40:0/1938764353 shutdown_connections 2026-02-13T01:21:39.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.599+0000 7fb7396106c0 1 --2- 10.20.193.40:0/1938764353 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb7341193d0 0x7fb734179d60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.599+0000 7fb7396106c0 1 --2- 10.20.193.40:0/1938764353 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb734118a20 0x7fb734118e90 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=18089292447191035148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.599+0000 7fb7396106c0 1 --2- 10.20.193.40:0/1938764353 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb7341178a0 0x7fb734117c90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.599+0000 7fb7396106c0 1 -- 10.20.193.40:0/1938764353 >> 10.20.193.40:0/1938764353 conn(0x7fb7340f4fc0 msgr2=0x7fb7341153d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.600+0000 7fb7396106c0 1 -- 10.20.193.40:0/1938764353 shutdown_connections 2026-02-13T01:21:39.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.600+0000 7fb7396106c0 1 -- 10.20.193.40:0/1938764353 wait complete. 2026-02-13T01:21:39.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.601+0000 7fb7396106c0 1 Processor -- start 2026-02-13T01:21:39.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.602+0000 7fb7396106c0 1 -- start start 2026-02-13T01:21:39.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.602+0000 7fb7396106c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7341178a0 0x7fb734100be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.602+0000 7fb732ffd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7341178a0 0x7fb734100be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.602+0000 7fb7396106c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb734118a20 0x7fb734179d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.602+0000 7fb7396106c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb7341193d0 0x7fb734101440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb7396106c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb734102070 con 0x7fb7341178a0 2026-02-13T01:21:39.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb732ffd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7341178a0 0x7fb734100be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48064/0 (socket says 10.20.193.40:48064) 2026-02-13T01:21:39.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb7396106c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb7341021e0 con 0x7fb734118a20 2026-02-13T01:21:39.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb7396106c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb7341023a0 con 0x7fb7341193d0 2026-02-13T01:21:39.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb732ffd6c0 1 -- 10.20.193.40:0/65145269 learned_addr learned my addr 10.20.193.40:0/65145269 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb732ffd6c0 1 -- 10.20.193.40:0/65145269 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb7341193d0 msgr2=0x7fb734101440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:21:39.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb732ffd6c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb7341193d0 0x7fb734101440 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb732ffd6c0 1 -- 10.20.193.40:0/65145269 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb734118a20 msgr2=0x7fb734179d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:21:39.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb732ffd6c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb734118a20 0x7fb734179d60 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb732ffd6c0 1 -- 10.20.193.40:0/65145269 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c013ae0 con 0x7fb7341178a0 2026-02-13T01:21:39.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.603+0000 7fb732ffd6c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7341178a0 0x7fb734100be0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb72800b750 tx=0x7fb72800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.604+0000 7fb713fff6c0 1 -- 10.20.193.40:0/65145269 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb728004290 con 0x7fb7341178a0 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.604+0000 7fb713fff6c0 1 -- 10.20.193.40:0/65145269 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb7280043f0 con 0x7fb7341178a0 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.604+0000 7fb713fff6c0 1 -- 10.20.193.40:0/65145269 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb72800e070 con 0x7fb7341178a0 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.604+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb734102680 con 0x7fb7341178a0 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.604+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb734102b90 con 0x7fb7341178a0 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.606+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73405d640 con 0x7fb7341178a0 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.606+0000 7fb713fff6c0 1 -- 10.20.193.40:0/65145269 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fb728002750 con 0x7fb7341178a0 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.607+0000 7fb713fff6c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb70c03f940 0x7fb70c05fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.607+0000 7fb713fff6c0 1 -- 10.20.193.40:0/65145269 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fb728051380 con 0x7fb7341178a0 2026-02-13T01:21:39.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.609+0000 7fb713fff6c0 1 -- 10.20.193.40:0/65145269 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb728004560 con 0x7fb7341178a0 2026-02-13T01:21:39.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.611+0000 7f79975776c0 1 -- 10.20.193.40:0/820639095 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 msgr2=0x7f7998154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.611+0000 7f79975776c0 1 --2- 10.20.193.40:0/820639095 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 0x7f7998154c00 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=17892048357416708880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7980009970 tx=0x7f798002ed50 comp rx=0 tx=0).stop 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.611+0000 7f79975776c0 1 -- 10.20.193.40:0/820639095 shutdown_connections 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.611+0000 7f79975776c0 1 --2- 10.20.193.40:0/820639095 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7998155340 0x7f79981757f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.611+0000 7f79975776c0 1 --2- 10.20.193.40:0/820639095 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 0x7f7998154c00 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=17892048357416708880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.611+0000 7f79975776c0 1 --2- 10.20.193.40:0/820639095 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7998113dc0 0x7f79981341a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.611+0000 7f79975776c0 1 -- 10.20.193.40:0/820639095 >> 10.20.193.40:0/820639095 conn(0x7f799805b720 msgr2=0x7f799805bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.611+0000 7f79975776c0 1 -- 10.20.193.40:0/820639095 shutdown_connections 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.611+0000 7f79975776c0 1 -- 10.20.193.40:0/820639095 wait complete. 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.612+0000 7f79975776c0 1 Processor -- start 2026-02-13T01:21:39.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.612+0000 7f79975776c0 1 -- start start 2026-02-13T01:21:39.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.613+0000 7f79975776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7998113dc0 0x7f7998154ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.613+0000 7f79975776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 0x7f7998175790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.613+0000 7f79975776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7998155340 0x7f79980ff870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.614+0000 7f7996d766c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7998155340 0x7f79980ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.614+0000 7f7996d766c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7998155340 0x7f79980ff870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48080/0 (socket says 10.20.193.40:48080) 2026-02-13T01:21:39.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.614+0000 7f7995d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 0x7f7998175790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.614+0000 7f7995d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 0x7f7998175790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:46122/0 (socket says 10.20.193.40:46122) 2026-02-13T01:21:39.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.615+0000 7f7996d766c0 1 -- 10.20.193.40:0/2635525635 learned_addr learned my addr 10.20.193.40:0/2635525635 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.615+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7998100000 con 0x7f7998155340 2026-02-13T01:21:39.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.615+0000 7f79965756c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7998113dc0 0x7f7998154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.615+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7998100170 con 0x7f7998113dc0 2026-02-13T01:21:39.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.615+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7998100840 con 0x7f79981347c0 2026-02-13T01:21:39.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.616+0000 7f7996d766c0 1 -- 10.20.193.40:0/2635525635 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 msgr2=0x7f7998175790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.616+0000 7f7996d766c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 0x7f7998175790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.616+0000 7f7996d766c0 1 -- 10.20.193.40:0/2635525635 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7998113dc0 msgr2=0x7f7998154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.616+0000 7f7996d766c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7998113dc0 0x7f7998154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.616+0000 7f7996d766c0 1 -- 10.20.193.40:0/2635525635 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7980009590 con 0x7f7998155340 2026-02-13T01:21:39.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.616+0000 7f7995d746c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 0x7f7998175790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:21:39.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.617+0000 7f7996d766c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7998155340 0x7f79980ff870 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7988006ea0 tx=0x7f798800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.618+0000 7f797f7fe6c0 1 -- 10.20.193.40:0/2635525635 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7988003810 con 0x7f7998155340 2026-02-13T01:21:39.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.618+0000 7f797f7fe6c0 1 -- 10.20.193.40:0/2635525635 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7988005030 con 0x7f7998155340 2026-02-13T01:21:39.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.618+0000 7f797f7fe6c0 1 -- 10.20.193.40:0/2635525635 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7988008840 con 0x7f7998155340 2026-02-13T01:21:39.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.618+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7998100ac0 con 0x7f7998155340 2026-02-13T01:21:39.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.618+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7998100f50 con 0x7f7998155340 2026-02-13T01:21:39.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.620+0000 7f797f7fe6c0 1 -- 10.20.193.40:0/2635525635 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f7988003970 con 0x7f7998155340 2026-02-13T01:21:39.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.620+0000 7f797f7fe6c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f797403f940 0x7f797405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.620+0000 7f797f7fe6c0 1 -- 10.20.193.40:0/2635525635 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f79880568b0 con 0x7f7998155340 2026-02-13T01:21:39.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.621+0000 7f79965756c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f797403f940 0x7f797405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.623 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.621+0000 7f79965756c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f797403f940 0x7f797405fdf0 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f798c005fd0 tx=0x7f798c0093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.627+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799817bc40 con 0x7f7998155340 2026-02-13T01:21:39.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.635+0000 7fb7327fc6c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb70c03f940 0x7fb70c05fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.636+0000 7fb7327fc6c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb70c03f940 0x7fb70c05fdf0 secure :-1 s=READY pgs=32 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb71c009580 tx=0x7fb71c0131c0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.658 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.657+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fda94113b70 con 0x7fda94114cb0 2026-02-13T01:21:39.693 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.692+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f39f0005b40 con 0x7f3a240b7c50 2026-02-13T01:21:39.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.697+0000 7f3a0f7fe6c0 1 -- 10.20.193.40:0/1219374209 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f3a20030680 con 0x7f3a240b7c50 2026-02-13T01:21:39.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.717+0000 7f346a3686c0 1 -- 10.20.193.40:0/2267550011 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f34641109f0 msgr2=0x7f3464171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.717+0000 7f346a3686c0 1 --2- 10.20.193.40:0/2267550011 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f34641109f0 0x7f3464171380 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=8116418094593009554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3458009970 tx=0x7f345802ed20 comp rx=0 tx=0).stop 2026-02-13T01:21:39.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.718+0000 7f346a3686c0 1 -- 10.20.193.40:0/2267550011 shutdown_connections 2026-02-13T01:21:39.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.718+0000 7f346a3686c0 1 --2- 10.20.193.40:0/2267550011 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f34641109f0 0x7f3464171380 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=8116418094593009554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.719+0000 7f346a3686c0 1 --2- 10.20.193.40:0/2267550011 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3464110040 0x7f34641104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.719+0000 7f346a3686c0 1 --2- 10.20.193.40:0/2267550011 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f346410eec0 0x7f346410f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.719+0000 7f346a3686c0 1 -- 10.20.193.40:0/2267550011 >> 10.20.193.40:0/2267550011 conn(0x7f34640ec5c0 msgr2=0x7f346410c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.719+0000 7f346a3686c0 1 -- 10.20.193.40:0/2267550011 shutdown_connections 2026-02-13T01:21:39.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.719+0000 7f346a3686c0 1 -- 10.20.193.40:0/2267550011 wait complete. 2026-02-13T01:21:39.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.721+0000 7f346a3686c0 1 Processor -- start 2026-02-13T01:21:39.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.721+0000 7f346a3686c0 1 -- start start 2026-02-13T01:21:39.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.721+0000 7f346a3686c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f346410eec0 0x7f3464062c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.721+0000 7f346a3686c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3464110040 0x7f34640632b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.721+0000 7f346a3686c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f34641109f0 0x7f3464063ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.721+0000 7f346a3686c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3464064630 con 0x7f3464110040 2026-02-13T01:21:39.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.721+0000 7f346a3686c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3464064770 con 0x7f346410eec0 2026-02-13T01:21:39.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.721+0000 7f346a3686c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3464064930 con 0x7f34641109f0 2026-02-13T01:21:39.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.722+0000 7f34688de6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f34641109f0 0x7f3464063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.723+0000 7f34637fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3464110040 0x7f34640632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.723+0000 7f34688de6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f34641109f0 0x7f3464063ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:46128/0 (socket says 10.20.193.40:46128) 2026-02-13T01:21:39.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.723+0000 7f34688de6c0 1 -- 10.20.193.40:0/212499772 learned_addr learned my addr 10.20.193.40:0/212499772 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.723+0000 7f3463fff6c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f346410eec0 0x7f3464062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7f34688de6c0 1 -- 10.20.193.40:0/212499772 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f346410eec0 msgr2=0x7f3464062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7f34688de6c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f346410eec0 0x7f3464062c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7f34688de6c0 1 -- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3464110040 msgr2=0x7f34640632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.723+0000 7f797f7fe6c0 1 -- 10.20.193.40:0/2635525635 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7988005a70 con 0x7f7998155340 2026-02-13T01:21:39.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7f34688de6c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3464110040 0x7f34640632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.725+0000 7f34688de6c0 1 -- 10.20.193.40:0/212499772 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345000a5b0 con 0x7f34641109f0 2026-02-13T01:21:39.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.725+0000 7f34637fe6c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3464110040 0x7f34640632b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:39.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.726+0000 7f34688de6c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f34641109f0 0x7f3464063ea0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3458005b00 tx=0x7f345802f7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.728 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.726+0000 7f34617fa6c0 1 -- 10.20.193.40:0/212499772 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34580028d0 con 0x7f34641109f0 2026-02-13T01:21:39.728 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.726+0000 7f34617fa6c0 1 -- 10.20.193.40:0/212499772 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f345802f9a0 con 0x7f34641109f0 2026-02-13T01:21:39.728 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.726+0000 7f34617fa6c0 1 -- 10.20.193.40:0/212499772 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34580312b0 con 0x7f34641109f0 2026-02-13T01:21:39.729 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.727+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3458009590 con 0x7f34641109f0 2026-02-13T01:21:39.729 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.727+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3464064f10 con 0x7f34641109f0 2026-02-13T01:21:39.729 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.728+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3464175670 con 0x7f34641109f0 2026-02-13T01:21:39.730 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.729+0000 7f34617fa6c0 1 -- 10.20.193.40:0/212499772 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f3458007760 con 0x7f34641109f0 2026-02-13T01:21:39.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.729+0000 7f34617fa6c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f343403f940 0x7f343405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.729+0000 7f34617fa6c0 1 -- 10.20.193.40:0/212499772 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f3458075650 con 0x7f34641109f0 2026-02-13T01:21:39.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.730+0000 7f3463fff6c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f343403f940 0x7f343405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.732 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.731+0000 7f34617fa6c0 1 -- 10.20.193.40:0/212499772 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f34580073f0 con 0x7f34641109f0 2026-02-13T01:21:39.732 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.731+0000 7f3463fff6c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f343403f940 0x7f343405fdf0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3450005830 tx=0x7f345000a310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.735 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.734+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/63442545 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc1a0113dc0 msgr2=0x7fc1a01341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.734+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/63442545 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc1a0113dc0 0x7fc1a01341a0 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=8807592165561115385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c009970 tx=0x7fc18c02ed50 comp rx=0 tx=0).stop 2026-02-13T01:21:39.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.734+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/63442545 shutdown_connections 2026-02-13T01:21:39.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.734+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/63442545 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1a0155340 0x7fc1a01757f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.734+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/63442545 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc1a01347c0 0x7fc1a0154c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.734+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/63442545 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc1a0113dc0 0x7fc1a01341a0 unknown :-1 s=CLOSED pgs=23 gs=2 cs=0 l=1 c_cookie=8807592165561115385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.734+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/63442545 >> 10.20.193.40:0/63442545 conn(0x7fc1a005b720 msgr2=0x7fc1a005bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.734+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/63442545 shutdown_connections 2026-02-13T01:21:39.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.734+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/63442545 wait complete. 2026-02-13T01:21:39.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.720+0000 7fda917fa6c0 1 -- 10.20.193.40:0/1155008253 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fda80002d80 con 0x7fda94114cb0 2026-02-13T01:21:39.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda6803f930 msgr2=0x7fda6805fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda6803f930 0x7fda6805fde0 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda8800a990 tx=0x7fda88002470 comp rx=0 tx=0).stop 2026-02-13T01:21:39.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda94114cb0 msgr2=0x7fda94119ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda94114cb0 0x7fda94119ea0 secure :-1 s=READY pgs=19 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda80005fd0 tx=0x7fda8000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 shutdown_connections 2026-02-13T01:21:39.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda6803f930 0x7fda6805fde0 unknown :-1 s=CLOSED pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.739 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda94114cb0 0x7fda94119ea0 unknown :-1 s=CLOSED pgs=19 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda94114120 0x7fda941192b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 --2- 10.20.193.40:0/1155008253 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda941137a0 0x7fda94118c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.724+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 >> 10.20.193.40:0/1155008253 conn(0x7fda94064120 msgr2=0x7fda940691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.725+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 shutdown_connections 2026-02-13T01:21:39.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.728+0000 7fda997a06c0 1 -- 10.20.193.40:0/1155008253 wait complete. 2026-02-13T01:21:39.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.738+0000 7fc1a4c8c6c0 1 Processor -- start 2026-02-13T01:21:39.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.738+0000 7fc1a4c8c6c0 1 -- start start 2026-02-13T01:21:39.741 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.740+0000 7fc1a4c8c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc1a0113dc0 0x7fc1a01341a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.741 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.740+0000 7fc1a4c8c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc1a01347c0 0x7fc1a01757f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.740+0000 7fc1a4c8c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1a0155340 0x7fc1a01866d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.740+0000 7fc1a4c8c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0186e60 con 0x7fc1a0113dc0 2026-02-13T01:21:39.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.740+0000 7fc1a4c8c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0186fd0 con 0x7fc1a0155340 2026-02-13T01:21:39.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.740+0000 7fc1a4c8c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0134f90 con 0x7fc1a01347c0 2026-02-13T01:21:39.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.741+0000 7fc19effd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc1a01347c0 0x7fc1a01757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.741+0000 7fc19ffff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1a0155340 0x7fc1a01866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.741+0000 7fc19f7fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc1a0113dc0 0x7fc1a01341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.742+0000 7fc19effd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc1a01347c0 0x7fc1a01757f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:46144/0 (socket says 10.20.193.40:46144) 2026-02-13T01:21:39.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.742+0000 7fc19effd6c0 1 -- 10.20.193.40:0/1932719337 learned_addr learned my addr 10.20.193.40:0/1932719337 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.754 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.753+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3a0803f940 msgr2=0x7f3a0805fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.754 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.753+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3a0803f940 0x7f3a0805fdf0 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1c00a580 tx=0x7f3a1c00a310 comp rx=0 tx=0).stop 2026-02-13T01:21:39.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.753+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3a240b7c50 msgr2=0x7f3a240ba5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.753+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3a240b7c50 0x7f3a240ba5c0 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a20007320 tx=0x7f3a2002f9f0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.755+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 shutdown_connections 2026-02-13T01:21:39.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.755+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3a0803f940 0x7f3a0805fdf0 unknown :-1 s=CLOSED pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.755+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3a240b8600 0x7f3a240bb1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.755+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3a240b7c50 0x7f3a240ba5c0 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.755+0000 7f3a2b5776c0 1 --2- 10.20.193.40:0/1219374209 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3a240b6ad0 0x7f3a240b9f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.755+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 >> 10.20.193.40:0/1219374209 conn(0x7f3a240941f0 msgr2=0x7f3a240b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.755+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 shutdown_connections 2026-02-13T01:21:39.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.755+0000 7f3a2b5776c0 1 -- 10.20.193.40:0/1219374209 wait complete. 2026-02-13T01:21:39.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.771+0000 7fc19ffff6c0 1 -- 10.20.193.40:0/1932719337 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc1a01347c0 msgr2=0x7fc1a01757f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.771+0000 7fc19ffff6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc1a01347c0 0x7fc1a01757f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.771+0000 7fc19ffff6c0 1 -- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc1a0113dc0 msgr2=0x7fc1a01341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.771+0000 7f2add7fa6c0 1 -- 10.20.193.40:0/1681754077 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f2abc0055c0 con 0x7f2af8114350 2026-02-13T01:21:39.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.771+0000 7fc19ffff6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc1a0113dc0 0x7fc1a01341a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.771+0000 7fc19ffff6c0 1 -- 10.20.193.40:0/1932719337 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c009590 con 0x7fc1a0155340 2026-02-13T01:21:39.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.772+0000 7fc19ffff6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1a0155340 0x7fc1a01866d0 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc19000b6c0 tx=0x7fc19000bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.774+0000 7fc19f7fe6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc1a0113dc0 0x7fc1a01341a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:21:39.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.774+0000 7fc19cff96c0 1 -- 10.20.193.40:0/1932719337 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc190004460 con 0x7fc1a0155340 2026-02-13T01:21:39.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.774+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a0135270 con 0x7fc1a0155340 2026-02-13T01:21:39.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.774+0000 7fc19cff96c0 1 -- 10.20.193.40:0/1932719337 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc190009030 con 0x7fc1a0155340 2026-02-13T01:21:39.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.774+0000 7fc19cff96c0 1 -- 10.20.193.40:0/1932719337 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc19000ce60 con 0x7fc1a0155340 2026-02-13T01:21:39.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.774+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a0135750 con 0x7fc1a0155340 2026-02-13T01:21:39.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.775+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a0179a60 con 0x7fc1a0155340 2026-02-13T01:21:39.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.776+0000 7f2adf7fe6c0 1 -- 10.20.193.40:0/1681754077 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v26)=0 v26) ==== 116+0+0 (secure 0 0 0) 0x7f2ae00128c0 con 0x7f2af8114350 2026-02-13T01:21:39.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.776+0000 7fc19cff96c0 1 -- 10.20.193.40:0/1932719337 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fc19000c410 con 0x7fc1a0155340 2026-02-13T01:21:39.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.776+0000 7fc19cff96c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc17403f980 0x7fc17405fe30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.777+0000 7fc19cff96c0 1 -- 10.20.193.40:0/1932719337 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fc190024540 con 0x7fc1a0155340 2026-02-13T01:21:39.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.777+0000 7fc19f7fe6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc17403f980 0x7fc17405fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.780+0000 7fc19cff96c0 1 -- 10.20.193.40:0/1932719337 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc190007710 con 0x7fc1a0155340 2026-02-13T01:21:39.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.780+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fb73405cd30 con 0x7fb7341178a0 2026-02-13T01:21:39.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.785+0000 7fb713fff6c0 1 -- 10.20.193.40:0/65145269 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7fb72800f8c0 con 0x7fb7341178a0 2026-02-13T01:21:39.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.780+0000 7fc19f7fe6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc17403f980 0x7fc17405fe30 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c0098c0 tx=0x7fc18c005c70 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.814+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb70c03f940 msgr2=0x7fb70c05fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.814+0000 7fb7396106c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb70c03f940 0x7fb70c05fdf0 secure :-1 s=READY pgs=32 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb71c009580 tx=0x7fb71c0131c0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.814+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7341178a0 msgr2=0x7fb734100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.814+0000 7fb7396106c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7341178a0 0x7fb734100be0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb72800b750 tx=0x7fb72800bc20 comp rx=0 tx=0).stop 2026-02-13T01:21:39.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.817+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 shutdown_connections 2026-02-13T01:21:39.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.817+0000 7fb7396106c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb70c03f940 0x7fb70c05fdf0 unknown :-1 s=CLOSED pgs=32 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.817+0000 7fb7396106c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb7341193d0 0x7fb734101440 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.817+0000 7fb7396106c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb734118a20 0x7fb734179d60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.817+0000 7fb7396106c0 1 --2- 10.20.193.40:0/65145269 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7341178a0 0x7fb734100be0 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.817+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 >> 10.20.193.40:0/65145269 conn(0x7fb7340f4fc0 msgr2=0x7fb7340f6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.818+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 shutdown_connections 2026-02-13T01:21:39.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.820+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/2982777814 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbcf4114ee0 msgr2=0x7fbcf4115380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.820+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/2982777814 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbcf4114ee0 0x7fbcf4115380 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=14543853576511183645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbce400aa40 tx=0x7fbce402fed0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.821+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/2982777814 shutdown_connections 2026-02-13T01:21:39.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.821+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/2982777814 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbcf4114ee0 0x7fbcf4115380 unknown :-1 s=CLOSED pgs=24 gs=3 cs=0 l=1 c_cookie=14543853576511183645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.821+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/2982777814 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbcf4114350 0x7fbcf41147c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.821+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/2982777814 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbcf405e400 0x7fbcf4113dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.821+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/2982777814 >> 10.20.193.40:0/2982777814 conn(0x7fbcf405b720 msgr2=0x7fbcf405bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.822+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/2982777814 shutdown_connections 2026-02-13T01:21:39.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.822+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/2982777814 wait complete. 2026-02-13T01:21:39.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.823+0000 7fbcf8a3e6c0 1 Processor -- start 2026-02-13T01:21:39.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.824+0000 7fb7396106c0 1 -- 10.20.193.40:0/65145269 wait complete. 2026-02-13T01:21:39.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.824+0000 7fbcf8a3e6c0 1 -- start start 2026-02-13T01:21:39.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.824+0000 7fbcf8a3e6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbcf405e400 0x7fbcf40fea20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.824+0000 7fbcf8a3e6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbcf4114350 0x7fbcf40ff070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.824+0000 7fbcf8a3e6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbcf4114ee0 0x7fbcf40ffc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.824+0000 7fbcf8a3e6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf41003f0 con 0x7fbcf4114ee0 2026-02-13T01:21:39.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.824+0000 7fbcf8a3e6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4100560 con 0x7fbcf405e400 2026-02-13T01:21:39.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.824+0000 7fbcf8a3e6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4100720 con 0x7fbcf4114350 2026-02-13T01:21:39.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.826+0000 7fbcf25756c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbcf4114350 0x7fbcf40ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 -- 10.20.193.40:0/1681754077 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ad003f940 msgr2=0x7f2ad005fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ad003f940 0x7f2ad005fdf0 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aec005b40 tx=0x7f2aec005fd0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 -- 10.20.193.40:0/1681754077 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af8114350 msgr2=0x7f2af80fe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af8114350 0x7f2af80fe580 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ae000b6c0 tx=0x7f2ae000bb90 comp rx=0 tx=0).stop 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 -- 10.20.193.40:0/1681754077 shutdown_connections 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ad003f940 0x7f2ad005fdf0 unknown :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2af8114ec0 0x7f2af80ff170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2af8114350 0x7f2af80fe580 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 --2- 10.20.193.40:0/1681754077 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2af805e390 0x7f2af80fdf30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.808+0000 7f2add7fa6c0 1 -- 10.20.193.40:0/1681754077 >> 10.20.193.40:0/1681754077 conn(0x7f2af805bb70 msgr2=0x7f2af805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.814+0000 7f2add7fa6c0 1 -- 10.20.193.40:0/1681754077 shutdown_connections 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.814+0000 7f2add7fa6c0 1 -- 10.20.193.40:0/1681754077 wait complete. 2026-02-13T01:21:39.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.826+0000 7fbcf35776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbcf4114ee0 0x7fbcf40ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.826+0000 7fbcf35776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbcf4114ee0 0x7fbcf40ffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48118/0 (socket says 10.20.193.40:48118) 2026-02-13T01:21:39.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.826+0000 7fbcf35776c0 1 -- 10.20.193.40:0/1691316395 learned_addr learned my addr 10.20.193.40:0/1691316395 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.828+0000 7fbcf35776c0 1 -- 10.20.193.40:0/1691316395 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbcf4114350 msgr2=0x7fbcf40ff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.828+0000 7fbcf35776c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbcf4114350 0x7fbcf40ff070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.828+0000 7fbcf35776c0 1 -- 10.20.193.40:0/1691316395 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbcf405e400 msgr2=0x7fbcf40fea20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:21:39.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.828+0000 7fbcf35776c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbcf405e400 0x7fbcf40fea20 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.828+0000 7fbcf35776c0 1 -- 10.20.193.40:0/1691316395 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce400a660 con 0x7fbcf4114ee0 2026-02-13T01:21:39.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.829+0000 7fbcf35776c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbcf4114ee0 0x7fbcf40ffc60 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbce400a260 tx=0x7fbce4005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.829+0000 7fbcd3fff6c0 1 -- 10.20.193.40:0/1691316395 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbce4003a30 con 0x7fbcf4114ee0 2026-02-13T01:21:39.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.830+0000 7fbcd3fff6c0 1 -- 10.20.193.40:0/1691316395 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbce4030af0 con 0x7fbcf4114ee0 2026-02-13T01:21:39.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.830+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf41009a0 con 0x7fbcf4114ee0 2026-02-13T01:21:39.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.832+0000 7fbcd3fff6c0 1 -- 10.20.193.40:0/1691316395 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbce4032550 con 0x7fbcf4114ee0 2026-02-13T01:21:39.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.833+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf4179fc0 con 0x7fbcf4114ee0 2026-02-13T01:21:39.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.835+0000 7fbcd3fff6c0 1 -- 10.20.193.40:0/1691316395 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fbce4032720 con 0x7fbcf4114ee0 2026-02-13T01:21:39.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.836+0000 7fbcd3fff6c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcc403f990 0x7fbcc405fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.836+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc0005310 con 0x7fbcf4114ee0 2026-02-13T01:21:39.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.836+0000 7fbcd3fff6c0 1 -- 10.20.193.40:0/1691316395 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fbce4076780 con 0x7fbcf4114ee0 2026-02-13T01:21:39.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.836+0000 7fbcf2d766c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcc403f990 0x7fbcc405fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.839+0000 7fbcf2d766c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcc403f990 0x7fbcc405fe40 secure :-1 s=READY pgs=35 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbce8004750 tx=0x7fbce8005f90 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.840+0000 7fbcd3fff6c0 1 -- 10.20.193.40:0/1691316395 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbce4037920 con 0x7fbcf4114ee0 2026-02-13T01:21:39.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.849+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/461268845 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2f8810e5a0 msgr2=0x7f2f8816ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.849+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/461268845 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2f8810e5a0 0x7f2f8816ef30 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=1318305512272957045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f8400aa40 tx=0x7f2f8402fe00 comp rx=0 tx=0).stop 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.849+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/461268845 shutdown_connections 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.849+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/461268845 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2f8810e5a0 0x7f2f8816ef30 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=1318305512272957045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.849+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/461268845 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f8810dbf0 0x7f2f8810e060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.849+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/461268845 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2f8810ca70 0x7f2f8810ce60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.849+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/461268845 >> 10.20.193.40:0/461268845 conn(0x7f2f880ea190 msgr2=0x7f2f8810a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.849+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/461268845 shutdown_connections 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.849+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/461268845 wait complete. 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.851+0000 7f2f8ebce6c0 1 Processor -- start 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.851+0000 7f2f8ebce6c0 1 -- start start 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.852+0000 7f2f8ebce6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2f8810ca70 0x7f2f8812eef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.852+0000 7f2f8ebce6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f8810dbf0 0x7f2f8814f440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.852+0000 7f2f8d3cb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f8810dbf0 0x7f2f8814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.852+0000 7f2f8d3cb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f8810dbf0 0x7f2f8814f440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48126/0 (socket says 10.20.193.40:48126) 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.852+0000 7f2f8d3cb6c0 1 -- 10.20.193.40:0/3149777047 learned_addr learned my addr 10.20.193.40:0/3149777047 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.852+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2f8810e5a0 0x7f2f8814f980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.852+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8814ff80 con 0x7f2f8810dbf0 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.852+0000 7f2f8dbcc6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2f8810ca70 0x7f2f8812eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.853+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881500f0 con 0x7f2f8810ca70 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.853+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881502b0 con 0x7f2f8810e5a0 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.853+0000 7f2f8d3cb6c0 1 -- 10.20.193.40:0/3149777047 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2f8810e5a0 msgr2=0x7f2f8814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.853+0000 7f2f8d3cb6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2f8810e5a0 0x7f2f8814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.853+0000 7f2f8d3cb6c0 1 -- 10.20.193.40:0/3149777047 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2f8810ca70 msgr2=0x7f2f8812eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.853+0000 7f2f8d3cb6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2f8810ca70 0x7f2f8812eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.853+0000 7f2f8d3cb6c0 1 -- 10.20.193.40:0/3149777047 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c0094c0 con 0x7f2f8810dbf0 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.854+0000 7f2f8d3cb6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f8810dbf0 0x7f2f8814f440 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f7c009fd0 tx=0x7f2f7c00bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.854+0000 7f2f76ffd6c0 1 -- 10.20.193.40:0/3149777047 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f7c004250 con 0x7f2f8810dbf0 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.854+0000 7f2f76ffd6c0 1 -- 10.20.193.40:0/3149777047 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2f7c009070 con 0x7f2f8810dbf0 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.854+0000 7f2f76ffd6c0 1 -- 10.20.193.40:0/3149777047 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f7c007440 con 0x7f2f8810dbf0 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.854+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8400a660 con 0x7f2f8810dbf0 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.854+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f88150890 con 0x7f2f8810dbf0 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.857+0000 7f2f76ffd6c0 1 -- 10.20.193.40:0/3149777047 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f2f7c0075d0 con 0x7f2f8810dbf0 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.857+0000 7f2f76ffd6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2f6c03f990 0x7f2f6c05fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:39.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.857+0000 7f2f76ffd6c0 1 -- 10.20.193.40:0/3149777047 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2f7c0515f0 con 0x7f2f8810dbf0 2026-02-13T01:21:39.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.858+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f58005310 con 0x7f2f8810dbf0 2026-02-13T01:21:39.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.861+0000 7f2f76ffd6c0 1 -- 10.20.193.40:0/3149777047 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2f7c013720 con 0x7f2f8810dbf0 2026-02-13T01:21:39.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.887+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7998101230 con 0x7f7998155340 2026-02-13T01:21:39.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.892+0000 7f797f7fe6c0 1 -- 10.20.193.40:0/2635525635 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v28)=0 v28) ==== 125+0+0 (secure 0 0 0) 0x7f7988004540 con 0x7f7998155340 2026-02-13T01:21:39.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.902+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f797403f940 msgr2=0x7f797405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.902+0000 7f79975776c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f797403f940 0x7f797405fdf0 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f798c005fd0 tx=0x7f798c0093f0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.902+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7998155340 msgr2=0x7f79980ff870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.902+0000 7f79975776c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7998155340 0x7f79980ff870 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7988006ea0 tx=0x7f798800cf10 comp rx=0 tx=0).stop 2026-02-13T01:21:39.932 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.885+0000 7f2f8dbcc6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2f6c03f990 0x7f2f6c05fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:39.932 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.905+0000 7f2f8dbcc6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2f6c03f990 0x7f2f6c05fe40 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f78004750 tx=0x7f2f78009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:39.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.946+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 shutdown_connections 2026-02-13T01:21:39.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.946+0000 7f79975776c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f797403f940 0x7f797405fdf0 unknown :-1 s=CLOSED pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.946+0000 7f79975776c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7998155340 0x7f79980ff870 unknown :-1 s=CLOSED pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.946+0000 7f79975776c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79981347c0 0x7f7998175790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.946+0000 7f79975776c0 1 --2- 10.20.193.40:0/2635525635 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7998113dc0 0x7f7998154ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.946+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 >> 10.20.193.40:0/2635525635 conn(0x7f799805b720 msgr2=0x7f79980f60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.948+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 shutdown_connections 2026-02-13T01:21:39.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.948+0000 7f79975776c0 1 -- 10.20.193.40:0/2635525635 wait complete. 2026-02-13T01:21:39.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.953+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f346410f2b0 con 0x7f34641109f0 2026-02-13T01:21:39.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.958+0000 7f34617fa6c0 1 -- 10.20.193.40:0/212499772 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v29)=0 v29) ==== 111+0+0 (secure 0 0 0) 0x7f3458033e60 con 0x7f34641109f0 2026-02-13T01:21:39.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.969+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fc1a0135b10 con 0x7fc1a0155340 2026-02-13T01:21:39.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.971+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f343403f940 msgr2=0x7f343405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.971+0000 7f346a3686c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f343403f940 0x7f343405fdf0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3450005830 tx=0x7f345000a310 comp rx=0 tx=0).stop 2026-02-13T01:21:39.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.973+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f34641109f0 msgr2=0x7f3464063ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.973+0000 7f346a3686c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f34641109f0 0x7f3464063ea0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3458005b00 tx=0x7f345802f7b0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.977+0000 7fc19cff96c0 1 -- 10.20.193.40:0/1932719337 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v29)=0 v29) ==== 106+0+0 (secure 0 0 0) 0x7fc1900078b0 con 0x7fc1a0155340 2026-02-13T01:21:39.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.982+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 shutdown_connections 2026-02-13T01:21:39.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.982+0000 7f346a3686c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f343403f940 0x7f343405fdf0 unknown :-1 s=CLOSED pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.982+0000 7f346a3686c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f34641109f0 0x7f3464063ea0 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.982+0000 7f346a3686c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3464110040 0x7f34640632b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.982+0000 7f346a3686c0 1 --2- 10.20.193.40:0/212499772 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f346410eec0 0x7f3464062c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.982+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 >> 10.20.193.40:0/212499772 conn(0x7f34640ec5c0 msgr2=0x7f346410c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.982+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 shutdown_connections 2026-02-13T01:21:39.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.982+0000 7f346a3686c0 1 -- 10.20.193.40:0/212499772 wait complete. 2026-02-13T01:21:39.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.986+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc17403f980 msgr2=0x7fc17405fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.986+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc17403f980 0x7fc17405fe30 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c0098c0 tx=0x7fc18c005c70 comp rx=0 tx=0).stop 2026-02-13T01:21:39.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.986+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1a0155340 msgr2=0x7fc1a01866d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:39.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.986+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1a0155340 0x7fc1a01866d0 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc19000b6c0 tx=0x7fc19000bb90 comp rx=0 tx=0).stop 2026-02-13T01:21:39.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.987+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fbcc00055c0 con 0x7fbcf4114ee0 2026-02-13T01:21:39.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.987+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 shutdown_connections 2026-02-13T01:21:39.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.987+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc17403f980 0x7fc17405fe30 unknown :-1 s=CLOSED pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.987+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1a0155340 0x7fc1a01866d0 unknown :-1 s=CLOSED pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.987+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc1a01347c0 0x7fc1a01757f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.987+0000 7fc1a4c8c6c0 1 --2- 10.20.193.40:0/1932719337 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc1a0113dc0 0x7fc1a01341a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:39.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.987+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 >> 10.20.193.40:0/1932719337 conn(0x7fc1a005b720 msgr2=0x7fc1a017c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:39.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.987+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 shutdown_connections 2026-02-13T01:21:39.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.987+0000 7fc1a4c8c6c0 1 -- 10.20.193.40:0/1932719337 wait complete. 2026-02-13T01:21:39.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.990+0000 7fbcd3fff6c0 1 -- 10.20.193.40:0/1691316395 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7fbce4036970 con 0x7fbcf4114ee0 2026-02-13T01:21:39.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.993+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f2f500051d0 con 0x7f2f8810dbf0 2026-02-13T01:21:40.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:39.999+0000 7f2f76ffd6c0 1 -- 10.20.193.40:0/3149777047 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v31)=0 v31) ==== 119+0+0 (secure 0 0 0) 0x7f2f7c0108c0 con 0x7f2f8810dbf0 2026-02-13T01:21:40.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.000+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcc403f990 msgr2=0x7fbcc405fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.000+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcc403f990 0x7fbcc405fe40 secure :-1 s=READY pgs=35 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbce8004750 tx=0x7fbce8005f90 comp rx=0 tx=0).stop 2026-02-13T01:21:40.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.000+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbcf4114ee0 msgr2=0x7fbcf40ffc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.000+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbcf4114ee0 0x7fbcf40ffc60 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbce400a260 tx=0x7fbce4005820 comp rx=0 tx=0).stop 2026-02-13T01:21:40.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2f6c03f990 msgr2=0x7f2f6c05fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 shutdown_connections 2026-02-13T01:21:40.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcc403f990 0x7fbcc405fe40 unknown :-1 s=CLOSED pgs=35 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbcf4114ee0 0x7fbcf40ffc60 unknown :-1 s=CLOSED pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbcf4114350 0x7fbcf40ff070 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7fbcf8a3e6c0 1 --2- 10.20.193.40:0/1691316395 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbcf405e400 0x7fbcf40fea20 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 >> 10.20.193.40:0/1691316395 conn(0x7fbcf405b720 msgr2=0x7fbcf40f4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:40.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.009+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 shutdown_connections 2026-02-13T01:21:40.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.010+0000 7fbcf8a3e6c0 1 -- 10.20.193.40:0/1691316395 wait complete. 2026-02-13T01:21:40.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2f6c03f990 0x7f2f6c05fe40 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f78004750 tx=0x7f2f78009260 comp rx=0 tx=0).stop 2026-02-13T01:21:40.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f8810dbf0 msgr2=0x7f2f8814f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.008+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f8810dbf0 0x7f2f8814f440 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f7c009fd0 tx=0x7f2f7c00bc90 comp rx=0 tx=0).stop 2026-02-13T01:21:40.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.012+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 shutdown_connections 2026-02-13T01:21:40.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.012+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2f6c03f990 0x7f2f6c05fe40 unknown :-1 s=CLOSED pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.012+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2f8810e5a0 0x7f2f8814f980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.012+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f8810dbf0 0x7f2f8814f440 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.012+0000 7f2f8ebce6c0 1 --2- 10.20.193.40:0/3149777047 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2f8810ca70 0x7f2f8812eef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.012+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 >> 10.20.193.40:0/3149777047 conn(0x7f2f880ea190 msgr2=0x7f2f8810a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:40.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.012+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 shutdown_connections 2026-02-13T01:21:40.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.013+0000 7f2f8ebce6c0 1 -- 10.20.193.40:0/3149777047 wait complete. 2026-02-13T01:21:40.046 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.046 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.047 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.047 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.047 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.054 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1540670752' entity='client.admin' 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial040", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1219374209' entity='client.admin' 2026-02-13T01:21:40.055 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.056 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/65145269' entity='client.admin' 2026-02-13T01:21:40.056 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:39 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2635525635' entity='client.admin' 2026-02-13T01:21:40.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.085+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f653c11aa50 con 0x7f653c1131f0 2026-02-13T01:21:40.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.088+0000 7f6539ffb6c0 1 -- 10.20.193.40:0/4205904241 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f6530004030 con 0x7f653c1131f0 2026-02-13T01:21:40.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.082+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fc9bc005b40 con 0x7fc9e80c5970 2026-02-13T01:21:40.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.093+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f651003f9a0 msgr2=0x7f651005fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.093+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f651003f9a0 0x7f651005fe50 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6528004750 tx=0x7f6528009260 comp rx=0 tx=0).stop 2026-02-13T01:21:40.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.093+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f653c1131f0 msgr2=0x7f653c118b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.093+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f653c1131f0 0x7f653c118b90 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6530006e50 tx=0x7f653000d040 comp rx=0 tx=0).stop 2026-02-13T01:21:40.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.097+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fa1d4098fa0 con 0x7fa1d40b7c50 2026-02-13T01:21:40.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.095+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 shutdown_connections 2026-02-13T01:21:40.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.095+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f651003f9a0 0x7f651005fe50 unknown :-1 s=CLOSED pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.099 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.095+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f653c114d20 0x7f653c119dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.099 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.095+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f653c114370 0x7f653c1191e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.099 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.095+0000 7f6541c4f6c0 1 --2- 10.20.193.40:0/4205904241 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f653c1131f0 0x7f653c118b90 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.099 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.095+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 >> 10.20.193.40:0/4205904241 conn(0x7f653c064140 msgr2=0x7f653c058250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:40.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.100+0000 7fa1bbfff6c0 1 -- 10.20.193.40:0/1301685980 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v34)=0 v34) ==== 133+0+0 (secure 0 0 0) 0x7fa1d4098fa0 con 0x7fa1d40b7c50 2026-02-13T01:21:40.106 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.104+0000 7fc9e77fe6c0 1 -- 10.20.193.40:0/588878271 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v33)=0 v33) ==== 120+0+0 (secure 0 0 0) 0x7fc9e0036660 con 0x7fc9e80c5970 2026-02-13T01:21:40.106 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.097+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 shutdown_connections 2026-02-13T01:21:40.106 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.097+0000 7f6541c4f6c0 1 -- 10.20.193.40:0/4205904241 wait complete. 2026-02-13T01:21:40.110 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.109+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1a803f910 msgr2=0x7fa1a805fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.109+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1a803f910 0x7fa1a805fdc0 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1d0005b40 tx=0x7fa1d0009310 comp rx=0 tx=0).stop 2026-02-13T01:21:40.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.109+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1d40b7c50 msgr2=0x7fa1d4118f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.109+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1d40b7c50 0x7fa1d4118f70 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1c40092e0 tx=0x7fa1c400bc50 comp rx=0 tx=0).stop 2026-02-13T01:21:40.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.110+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 shutdown_connections 2026-02-13T01:21:40.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.110+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1a803f910 0x7fa1a805fdc0 unknown :-1 s=CLOSED pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.110+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1d40b8600 0x7fa1d4009a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.110+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1d40b7c50 0x7fa1d4118f70 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.110+0000 7fa1dbfff6c0 1 --2- 10.20.193.40:0/1301685980 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1d40b6ad0 0x7fa1d4009240 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.109+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc9cc03f940 msgr2=0x7fc9cc05fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.109+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc9cc03f940 0x7fc9cc05fdf0 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9d8005fd0 tx=0x7fc9d80093f0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.110+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc9e80c5970 msgr2=0x7fc9e80ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.110+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc9e80c5970 0x7fc9e80ae030 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9e000a2e0 tx=0x7fc9e0030800 comp rx=0 tx=0).stop 2026-02-13T01:21:40.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.110+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 >> 10.20.193.40:0/1301685980 conn(0x7fa1d40941f0 msgr2=0x7fa1d4095fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:40.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.110+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 shutdown_connections 2026-02-13T01:21:40.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.111+0000 7fa1dbfff6c0 1 -- 10.20.193.40:0/1301685980 wait complete. 2026-02-13T01:21:40.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.112+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 shutdown_connections 2026-02-13T01:21:40.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.112+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc9cc03f940 0x7fc9cc05fdf0 unknown :-1 s=CLOSED pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.112+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc9e80c5970 0x7fc9e80ae030 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.114 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.112+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc9e80c4fc0 0x7fc9e80ad440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.115 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.112+0000 7fc9ef5776c0 1 --2- 10.20.193.40:0/588878271 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc9e80c3e40 0x7fc9e80acdf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.115 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.112+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 >> 10.20.193.40:0/588878271 conn(0x7fc9e80a10e0 msgr2=0x7fc9e80a2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:40.118 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.117+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 shutdown_connections 2026-02-13T01:21:40.118 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.117+0000 7fc9ef5776c0 1 -- 10.20.193.40:0/588878271 wait complete. 2026-02-13T01:21:40.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.149+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/3469391322 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 msgr2=0x7f2cb01341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.149+0000 7f2cb4b886c0 1 --2- 10.20.193.40:0/3469391322 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 0x7f2cb01341a0 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=13772319508154264958 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ca4009970 tx=0x7f2ca402ed50 comp rx=0 tx=0).stop 2026-02-13T01:21:40.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.159+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/3965754419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1330114ef0 msgr2=0x7f1330175880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.159+0000 7f1334f2c6c0 1 --2- 10.20.193.40:0/3965754419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1330114ef0 0x7f1330175880 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=8049812481121460413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f132000aa40 tx=0x7f132002fdf0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.159+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/3965754419 shutdown_connections 2026-02-13T01:21:40.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.159+0000 7f1334f2c6c0 1 --2- 10.20.193.40:0/3965754419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1330114ef0 0x7f1330175880 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=8049812481121460413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.159+0000 7f1334f2c6c0 1 --2- 10.20.193.40:0/3965754419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1330114540 0x7f13301149b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.159+0000 7f1334f2c6c0 1 --2- 10.20.193.40:0/3965754419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f13301133c0 0x7f13301137b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.159+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/3965754419 >> 10.20.193.40:0/3965754419 conn(0x7f13300642f0 msgr2=0x7f1330064710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:40.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.159+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/3965754419 shutdown_connections 2026-02-13T01:21:40.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.159+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/3965754419 wait complete. 2026-02-13T01:21:40.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.160+0000 7f1334f2c6c0 1 Processor -- start 2026-02-13T01:21:40.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.160+0000 7f1334f2c6c0 1 -- start start 2026-02-13T01:21:40.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f1334f2c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13301133c0 0x7f13300fded0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f1334f2c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1330114540 0x7f1330175880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f132e5756c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13301133c0 0x7f13300fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f132e5756c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13301133c0 0x7f13300fded0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:36796/0 (socket says 10.20.193.40:36796) 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f132e5756c0 1 -- 10.20.193.40:0/2007174075 learned_addr learned my addr 10.20.193.40:0/2007174075 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f1334f2c6c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1330114ef0 0x7f13300fe730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f132dd746c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1330114540 0x7f1330175880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/2007174075 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f13300ff2d0 con 0x7f13301133c0 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/2007174075 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f13300ff440 con 0x7f1330114ef0 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.161+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/2007174075 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13300ff600 con 0x7f1330114540 2026-02-13T01:21:40.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.162+0000 7f132ed766c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1330114ef0 0x7f13300fe730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:40.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.162+0000 7f132dd746c0 1 -- 10.20.193.40:0/2007174075 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1330114ef0 msgr2=0x7f13300fe730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.162+0000 7f132dd746c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1330114ef0 0x7f13300fe730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.162+0000 7f132dd746c0 1 -- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13301133c0 msgr2=0x7f13300fded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.162+0000 7f132dd746c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13301133c0 0x7f13300fded0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.162+0000 7f132dd746c0 1 -- 10.20.193.40:0/2007174075 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132000a660 con 0x7f1330114540 2026-02-13T01:21:40.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.162+0000 7f132ed766c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1330114ef0 0x7f13300fe730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:40.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.162+0000 7f132dd746c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1330114540 0x7f1330175880 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f131800b6c0 tx=0x7f131800bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:40.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.163+0000 7f132e5756c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13301133c0 0x7f13300fded0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:21:40.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.163+0000 7f13177fe6c0 1 -- 10.20.193.40:0/2007174075 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1318004560 con 0x7f1330114540 2026-02-13T01:21:40.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.163+0000 7f13177fe6c0 1 -- 10.20.193.40:0/2007174075 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1318009030 con 0x7f1330114540 2026-02-13T01:21:40.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.163+0000 7f13177fe6c0 1 -- 10.20.193.40:0/2007174075 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13180071c0 con 0x7f1330114540 2026-02-13T01:21:40.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.163+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/2007174075 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13300ff8e0 con 0x7f1330114540 2026-02-13T01:21:40.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.163+0000 7f1334f2c6c0 1 -- 10.20.193.40:0/2007174075 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13300ffd70 con 0x7f1330114540 2026-02-13T01:21:40.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.164+0000 7f13177fe6c0 1 -- 10.20.193.40:0/2007174075 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f131800c4a0 con 0x7f1330114540 2026-02-13T01:21:40.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.164+0000 7f13177fe6c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f130403f990 0x7f130405fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:40.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.164+0000 7f13177fe6c0 1 -- 10.20.193.40:0/2007174075 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f1318051190 con 0x7f1330114540 2026-02-13T01:21:40.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.165+0000 7f132e5756c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f130403f990 0x7f130405fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:40.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.165+0000 7f132e5756c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f130403f990 0x7f130405fe40 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1324009470 tx=0x7f1324009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:40.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.165+0000 7f13157fa6c0 1 -- 10.20.193.40:0/2007174075 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f8005310 con 0x7f1330114540 2026-02-13T01:21:40.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.166+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/3469391322 shutdown_connections 2026-02-13T01:21:40.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.166+0000 7f2cb4b886c0 1 --2- 10.20.193.40:0/3469391322 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2cb0155310 0x7f2cb01757c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.166+0000 7f2cb4b886c0 1 --2- 10.20.193.40:0/3469391322 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cb0134770 0x7f2cb0154bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.166+0000 7f2cb4b886c0 1 --2- 10.20.193.40:0/3469391322 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 0x7f2cb01341a0 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=13772319508154264958 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.166+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/3469391322 >> 10.20.193.40:0/3469391322 conn(0x7f2cb005b8e0 msgr2=0x7f2cb005bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:40.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.166+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/3469391322 shutdown_connections 2026-02-13T01:21:40.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.166+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/3469391322 wait complete. 2026-02-13T01:21:40.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.168+0000 7f2cb4b886c0 1 Processor -- start 2026-02-13T01:21:40.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.168+0000 7f2cb4b886c0 1 -- start start 2026-02-13T01:21:40.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.169+0000 7f2cb4b886c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 0x7f2cb0154bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:40.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.169+0000 7f2cb4b886c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2cb0134770 0x7f2cb01757a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:40.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.169+0000 7f2cb4b886c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cb0155310 0x7f2cb00fdb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:40.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.168+0000 7f13177fe6c0 1 -- 10.20.193.40:0/2007174075 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f13180076e0 con 0x7f1330114540 2026-02-13T01:21:40.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.169+0000 7f2cad5736c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2cb0134770 0x7f2cb01757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:40.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.169+0000 7f2cadd746c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 0x7f2cb0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:40.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.169+0000 7f2cadd746c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 0x7f2cb0154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:40348/0 (socket says 10.20.193.40:40348) 2026-02-13T01:21:40.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.169+0000 7f2cadd746c0 1 -- 10.20.193.40:0/1958604613 learned_addr learned my addr 10.20.193.40:0/1958604613 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:40.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.171+0000 7f2cae5756c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cb0155310 0x7f2cb00fdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:40.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.171+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/1958604613 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00fe320 con 0x7f2cb0155310 2026-02-13T01:21:40.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.171+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/1958604613 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00fe490 con 0x7f2cb0113dc0 2026-02-13T01:21:40.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.171+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/1958604613 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00fead0 con 0x7f2cb0134770 2026-02-13T01:21:40.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.172+0000 7f2cadd746c0 1 -- 10.20.193.40:0/1958604613 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2cb0134770 msgr2=0x7f2cb01757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.172+0000 7f2cadd746c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2cb0134770 0x7f2cb01757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.172+0000 7f2cadd746c0 1 -- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cb0155310 msgr2=0x7f2cb00fdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.172+0000 7f2cadd746c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cb0155310 0x7f2cb00fdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.172+0000 7f2cadd746c0 1 -- 10.20.193.40:0/1958604613 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca4009590 con 0x7f2cb0113dc0 2026-02-13T01:21:40.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.172+0000 7f2cad5736c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2cb0134770 0x7f2cb01757a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:40.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.172+0000 7f2cae5756c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cb0155310 0x7f2cb00fdb90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:21:40.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.173+0000 7f2cadd746c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 0x7f2cb0154bd0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ca4005b20 tx=0x7f2ca402fac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:40.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.174+0000 7f2c977fe6c0 1 -- 10.20.193.40:0/1958604613 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ca40071c0 con 0x7f2cb0113dc0 2026-02-13T01:21:40.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.174+0000 7f2c977fe6c0 1 -- 10.20.193.40:0/1958604613 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2ca402fe80 con 0x7f2cb0113dc0 2026-02-13T01:21:40.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.174+0000 7f2c977fe6c0 1 -- 10.20.193.40:0/1958604613 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ca40312b0 con 0x7f2cb0113dc0 2026-02-13T01:21:40.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.174+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/1958604613 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb00fed50 con 0x7f2cb0113dc0 2026-02-13T01:21:40.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.174+0000 7f2cb4b886c0 1 -- 10.20.193.40:0/1958604613 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb00ff180 con 0x7f2cb0113dc0 2026-02-13T01:21:40.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.175+0000 7f2c957fa6c0 1 -- 10.20.193.40:0/1958604613 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c78005310 con 0x7f2cb0113dc0 2026-02-13T01:21:40.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.176+0000 7f2c977fe6c0 1 -- 10.20.193.40:0/1958604613 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f2ca4007810 con 0x7f2cb0113dc0 2026-02-13T01:21:40.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.177+0000 7f2c977fe6c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2c8803f990 0x7f2c8805fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:40.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.177+0000 7f2c977fe6c0 1 -- 10.20.193.40:0/1958604613 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2ca407a550 con 0x7f2cb0113dc0 2026-02-13T01:21:40.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.178+0000 7f2cad5736c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2c8803f990 0x7f2c8805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:40.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.179+0000 7f2cad5736c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2c8803f990 0x7f2c8805fe40 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cb005ebb0 tx=0x7f2c98009190 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:40.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.181+0000 7f2c977fe6c0 1 -- 10.20.193.40:0/1958604613 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2ca4031440 con 0x7f2cb0113dc0 2026-02-13T01:21:40.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1540670752' entity='client.admin' 2026-02-13T01:21:40.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:40.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:40.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial040", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:40.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:40.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:40.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1219374209' entity='client.admin' 2026-02-13T01:21:40.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/65145269' entity='client.admin' 2026-02-13T01:21:40.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:39 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2635525635' entity='client.admin' 2026-02-13T01:21:40.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1540670752' entity='client.admin' 2026-02-13T01:21:40.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:40.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:40.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial040", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:40.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:40.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:40.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1219374209' entity='client.admin' 2026-02-13T01:21:40.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:40.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/65145269' entity='client.admin' 2026-02-13T01:21:40.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:39 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2635525635' entity='client.admin' 2026-02-13T01:21:40.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.302+0000 7f13157fa6c0 1 -- 10.20.193.40:0/2007174075 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f12f80055c0 con 0x7f1330114540 2026-02-13T01:21:40.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.305+0000 7f13177fe6c0 1 -- 10.20.193.40:0/2007174075 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v35)=0 v35) ==== 115+0+0 (secure 0 0 0) 0x7f13180076e0 con 0x7f1330114540 2026-02-13T01:21:40.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.306+0000 7f2c957fa6c0 1 -- 10.20.193.40:0/1958604613 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f2c780055c0 con 0x7f2cb0113dc0 2026-02-13T01:21:40.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.309+0000 7f13157fa6c0 1 -- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f130403f990 msgr2=0x7f130405fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.309+0000 7f13157fa6c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f130403f990 0x7f130405fe40 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1324009470 tx=0x7f1324009260 comp rx=0 tx=0).stop 2026-02-13T01:21:40.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.309+0000 7f13157fa6c0 1 -- 10.20.193.40:0/2007174075 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1330114540 msgr2=0x7f1330175880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.309+0000 7f13157fa6c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1330114540 0x7f1330175880 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f131800b6c0 tx=0x7f131800bb90 comp rx=0 tx=0).stop 2026-02-13T01:21:40.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.310+0000 7f13157fa6c0 1 -- 10.20.193.40:0/2007174075 shutdown_connections 2026-02-13T01:21:40.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.310+0000 7f13157fa6c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f130403f990 0x7f130405fe40 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.310+0000 7f13157fa6c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1330114ef0 0x7f13300fe730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.310+0000 7f13157fa6c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1330114540 0x7f1330175880 unknown :-1 s=CLOSED pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.310+0000 7f13157fa6c0 1 --2- 10.20.193.40:0/2007174075 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13301133c0 0x7f13300fded0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.310+0000 7f13157fa6c0 1 -- 10.20.193.40:0/2007174075 >> 10.20.193.40:0/2007174075 conn(0x7f13300642f0 msgr2=0x7f13300f3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:40.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.310+0000 7f2c977fe6c0 1 -- 10.20.193.40:0/1958604613 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v36)=0 v36) ==== 129+0+0 (secure 0 0 0) 0x7f2ca403a630 con 0x7f2cb0113dc0 2026-02-13T01:21:40.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.311+0000 7f13157fa6c0 1 -- 10.20.193.40:0/2007174075 shutdown_connections 2026-02-13T01:21:40.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.311+0000 7f13157fa6c0 1 -- 10.20.193.40:0/2007174075 wait complete. 2026-02-13T01:21:40.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.313+0000 7f2c957fa6c0 1 -- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2c8803f990 msgr2=0x7f2c8805fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.313+0000 7f2c957fa6c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2c8803f990 0x7f2c8805fe40 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cb005ebb0 tx=0x7f2c98009190 comp rx=0 tx=0).stop 2026-02-13T01:21:40.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.313+0000 7f2c957fa6c0 1 -- 10.20.193.40:0/1958604613 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 msgr2=0x7f2cb0154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:40.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.313+0000 7f2c957fa6c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 0x7f2cb0154bd0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ca4005b20 tx=0x7f2ca402fac0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.315+0000 7f2c957fa6c0 1 -- 10.20.193.40:0/1958604613 shutdown_connections 2026-02-13T01:21:40.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.315+0000 7f2c957fa6c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2c8803f990 0x7f2c8805fe40 unknown :-1 s=CLOSED pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.315+0000 7f2c957fa6c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cb0155310 0x7f2cb00fdb90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.315+0000 7f2c957fa6c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2cb0134770 0x7f2cb01757a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.315+0000 7f2c957fa6c0 1 --2- 10.20.193.40:0/1958604613 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2cb0113dc0 0x7f2cb0154bd0 unknown :-1 s=CLOSED pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:40.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.315+0000 7f2c957fa6c0 1 -- 10.20.193.40:0/1958604613 >> 10.20.193.40:0/1958604613 conn(0x7f2cb005b8e0 msgr2=0x7f2cb00f3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:40.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.315+0000 7f2c957fa6c0 1 -- 10.20.193.40:0/1958604613 shutdown_connections 2026-02-13T01:21:40.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:40.316+0000 7f2c957fa6c0 1 -- 10.20.193.40:0/1958604613 wait complete. 2026-02-13T01:21:40.548 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.549 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.549 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.598 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.598 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.647 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.659 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.665 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.665 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.666 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.666 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.666 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.666 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.666 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.666 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '304b456c-087a-11f1-98ea-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial040') 2026-02-13T01:21:40.666 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config dump 2026-02-13T01:21:40.886 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:41.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.084+0000 7f6ac75776c0 1 -- 10.20.193.40:0/1574388580 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac81199a0 msgr2=0x7f6ac8116df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:41.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.084+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/1574388580 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac81199a0 0x7f6ac8116df0 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=7849264152659926741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ab800aa40 tx=0x7f6ab802fdf0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.084+0000 7f6ac75776c0 1 -- 10.20.193.40:0/1574388580 shutdown_connections 2026-02-13T01:21:41.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.084+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/1574388580 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac81199a0 0x7f6ac8116df0 unknown :-1 s=CLOSED pgs=115 gs=1 cs=0 l=1 c_cookie=7849264152659926741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.084+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/1574388580 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ac8118f30 0x7f6ac8119380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.084+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/1574388580 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ac811b3f0 0x7f6ac811b7c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.084+0000 7f6ac75776c0 1 -- 10.20.193.40:0/1574388580 >> 10.20.193.40:0/1574388580 conn(0x7f6ac805b290 msgr2=0x7f6ac805b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:41.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.085+0000 7f6ac75776c0 1 -- 10.20.193.40:0/1574388580 shutdown_connections 2026-02-13T01:21:41.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.085+0000 7f6ac75776c0 1 -- 10.20.193.40:0/1574388580 wait complete. 2026-02-13T01:21:41.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.085+0000 7f6ac75776c0 1 Processor -- start 2026-02-13T01:21:41.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.085+0000 7f6ac75776c0 1 -- start start 2026-02-13T01:21:41.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac75776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac8118f30 0x7f6ac80fda60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:41.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac75776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ac81199a0 0x7f6ac80fdfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:41.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac75776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ac811b3f0 0x7f6ac8103310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac75776c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8103960 con 0x7f6ac8118f30 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac75776c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8103ad0 con 0x7f6ac811b3f0 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac75776c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8103c90 con 0x7f6ac81199a0 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac5d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ac81199a0 0x7f6ac80fdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac5d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ac81199a0 0x7f6ac80fdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:43738/0 (socket says 10.20.193.40:43738) 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac5d746c0 1 -- 10.20.193.40:0/3736342821 learned_addr learned my addr 10.20.193.40:0/3736342821 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac6d766c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ac811b3f0 0x7f6ac8103310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac65756c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac8118f30 0x7f6ac80fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac5d746c0 1 -- 10.20.193.40:0/3736342821 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ac811b3f0 msgr2=0x7f6ac8103310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac5d746c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ac811b3f0 0x7f6ac8103310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac5d746c0 1 -- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac8118f30 msgr2=0x7f6ac80fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac5d746c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac8118f30 0x7f6ac80fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac5d746c0 1 -- 10.20.193.40:0/3736342821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab800a660 con 0x7f6ac81199a0 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.086+0000 7f6ac5d746c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ac81199a0 0x7f6ac80fdfa0 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ab0005dc0 tx=0x7f6ab000bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.087+0000 7f6aaf7fe6c0 1 -- 10.20.193.40:0/3736342821 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ab0004250 con 0x7f6ac81199a0 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.087+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac8103f70 con 0x7f6ac81199a0 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.087+0000 7f6aaf7fe6c0 1 -- 10.20.193.40:0/3736342821 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6ab0009070 con 0x7f6ac81199a0 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.087+0000 7f6aaf7fe6c0 1 -- 10.20.193.40:0/3736342821 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ab00071c0 con 0x7f6ac81199a0 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.087+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac8104630 con 0x7f6ac81199a0 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.087+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac8104190 con 0x7f6ac81199a0 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.088+0000 7f6aaf7fe6c0 1 -- 10.20.193.40:0/3736342821 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f6ab00043b0 con 0x7f6ac81199a0 2026-02-13T01:21:41.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.088+0000 7f6aaf7fe6c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6aa003f940 0x7f6aa005fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:41.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.088+0000 7f6aaf7fe6c0 1 -- 10.20.193.40:0/3736342821 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f6ab0051400 con 0x7f6ac81199a0 2026-02-13T01:21:41.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.088+0000 7f6ac65756c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6aa003f940 0x7f6aa005fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:41.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.089+0000 7f6ac65756c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6aa003f940 0x7f6aa005fdf0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6abc004750 tx=0x7f6abc009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:41.093 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.090+0000 7f6aaf7fe6c0 1 -- 10.20.193.40:0/3736342821 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6ab00076e0 con 0x7f6ac81199a0 2026-02-13T01:21:41.192 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.191+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6ac805e670 con 0x7f6ac81199a0 2026-02-13T01:21:41.193 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.193 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1691316395' entity='client.admin' 2026-02-13T01:21:41.193 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3149777047' entity='client.admin' 2026-02-13T01:21:41.193 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.193 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.193 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.193 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.193 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4205904241' entity='client.admin' 2026-02-13T01:21:41.193 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:21:41.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:41.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.192+0000 7f6aaf7fe6c0 1 -- 10.20.193.40:0/3736342821 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v36) ==== 59+0+19758 (secure 0 0 0) 0x7f6ab000a8d0 con 0x7f6ac81199a0 2026-02-13T01:21:41.195 INFO:teuthology.orchestra.run.trial040.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global dev auth_debug true 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 * 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global dev debug_asserts_on_shutdown true 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global basic log_to_file true 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global basic log_to_journald false 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global basic log_to_stderr false 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global advanced mon_allow_pool_delete true 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global advanced mon_cluster_log_to_file true 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-13T01:21:41.196 INFO:teuthology.orchestra.run.trial040.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global dev ms_die_on_bug true 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global dev ms_die_on_old_message true 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global dev ms_die_on_skipped_message false 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-13T01:21:41.197 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced debug_mon 20/20 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced debug_ms 1/1 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced debug_paxos 20/20 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced mon_data_avail_warn 5 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T01:21:41.198 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced client_mount_timeout 30 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced debug_cephsqlite 20/20 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced debug_client 20/20 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced debug_mgr 20/20 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced debug_ms 1/1 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-13T01:21:41.199 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced mgr/snap_schedule/log_level debug 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:osd dev bdev_debug_aio true 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:osd dev bluestore_fsck_on_mount true 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced debug_bluefs 20/20 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced debug_bluestore 20/20 2026-02-13T01:21:41.200 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced debug_ms 1/1 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced debug_osd 20/20 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced debug_rocksdb 10/10 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd dev osd_debug_misdirected_ops true 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd dev osd_debug_op_order true 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd dev osd_debug_shutdown true 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_max_omap_entries_per_request 10 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-13T01:21:41.201 INFO:teuthology.orchestra.run.trial040.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_memory_target_autotune true 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_objectstore bluestore * 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_op_queue debug_random * 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_recover_clone_overlap true 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced debug_mds 20/20 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T01:21:41.202 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced debug_ms 2/2 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced mds_bal_merge_size 5 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced mds_bal_split_bits 3 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced mds_bal_split_size 100 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds dev mds_debug_frag true 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds dev mds_debug_scatterstat true 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced mds_export_ephemeral_random_max 0.200000 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds dev mds_verify_scatter true 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T01:21:41.203 INFO:teuthology.orchestra.run.trial040.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client advanced client_mount_timeout 600 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client advanced debug_client 20/20 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client advanced debug_ms 1/1 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client advanced fuse_default_permissions false * 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client advanced fuse_set_user_groups true 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-13T01:21:41.204 INFO:teuthology.orchestra.run.trial040.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-13T01:21:41.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6aa003f940 msgr2=0x7f6aa005fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:41.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6aa003f940 0x7f6aa005fdf0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6abc004750 tx=0x7f6abc009390 comp rx=0 tx=0).stop 2026-02-13T01:21:41.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ac81199a0 msgr2=0x7f6ac80fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:41.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ac81199a0 0x7f6ac80fdfa0 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ab0005dc0 tx=0x7f6ab000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 shutdown_connections 2026-02-13T01:21:41.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6aa003f940 0x7f6aa005fdf0 unknown :-1 s=CLOSED pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ac811b3f0 0x7f6ac8103310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ac81199a0 0x7f6ac80fdfa0 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 --2- 10.20.193.40:0/3736342821 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac8118f30 0x7f6ac80fda60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:41.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 >> 10.20.193.40:0/3736342821 conn(0x7f6ac805b290 msgr2=0x7f6ac80f4200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:41.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 shutdown_connections 2026-02-13T01:21:41.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:41.193+0000 7f6ac75776c0 1 -- 10.20.193.40:0/3736342821 wait complete. 2026-02-13T01:21:41.208 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.208 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1691316395' entity='client.admin' 2026-02-13T01:21:41.208 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3149777047' entity='client.admin' 2026-02-13T01:21:41.208 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.208 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4205904241' entity='client.admin' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:21:41.209 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:21:41.210 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1691316395' entity='client.admin' 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3149777047' entity='client.admin' 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4205904241' entity='client.admin' 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' 2026-02-13T01:21:41.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:41.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:21:41.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:21:41.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:21:41.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:41.341 INFO:tasks.cephadm:Deploying OSDs... 2026-02-13T01:21:41.341 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:21:41.341 DEBUG:teuthology.orchestra.run.trial040:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T01:21:41.378 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T01:21:41.378 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_1 2026-02-13T01:21:41.453 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T01:21:41.453 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:41.453 INFO:teuthology.orchestra.run.trial040.stdout:Device: 6h/6d Inode: 1088 Links: 1 2026-02-13T01:21:41.454 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:41.454 INFO:teuthology.orchestra.run.trial040.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:41.454 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-13 01:21:11.464579751 +0000 2026-02-13T01:21:41.454 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-13 01:19:17.287669717 +0000 2026-02-13T01:21:41.454 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-13 01:19:17.287669717 +0000 2026-02-13T01:21:41.454 INFO:teuthology.orchestra.run.trial040.stdout: Birth: 2026-02-13 01:19:17.287669717 +0000 2026-02-13T01:21:41.454 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T01:21:41.546 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-13T01:21:41.546 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-13T01:21:41.546 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000212365 s, 2.4 MB/s 2026-02-13T01:21:41.549 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T01:21:41.588 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_2 2026-02-13T01:21:41.667 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T01:21:41.667 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:41.667 INFO:teuthology.orchestra.run.trial040.stdout:Device: 6h/6d Inode: 1081 Links: 1 2026-02-13T01:21:41.667 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:41.667 INFO:teuthology.orchestra.run.trial040.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:41.667 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-13 01:21:11.464579751 +0000 2026-02-13T01:21:41.667 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-13 01:19:17.286922094 +0000 2026-02-13T01:21:41.667 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-13 01:19:17.286922094 +0000 2026-02-13T01:21:41.667 INFO:teuthology.orchestra.run.trial040.stdout: Birth: 2026-02-13 01:19:17.286922094 +0000 2026-02-13T01:21:41.668 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T01:21:41.754 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.671+0000 7f9630bc8fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:21:41.760 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-13T01:21:41.760 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-13T01:21:41.760 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000214358 s, 2.4 MB/s 2026-02-13T01:21:41.763 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T01:21:41.801 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_3 2026-02-13T01:21:41.880 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T01:21:41.880 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:41.880 INFO:teuthology.orchestra.run.trial040.stdout:Device: 6h/6d Inode: 1065 Links: 1 2026-02-13T01:21:41.880 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:41.881 INFO:teuthology.orchestra.run.trial040.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:41.881 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-13 01:21:11.464579751 +0000 2026-02-13T01:21:41.881 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-13 01:19:17.283922145 +0000 2026-02-13T01:21:41.881 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-13 01:19:17.283922145 +0000 2026-02-13T01:21:41.881 INFO:teuthology.orchestra.run.trial040.stdout: Birth: 2026-02-13 01:19:17.283922145 +0000 2026-02-13T01:21:41.881 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T01:21:41.972 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-13T01:21:41.972 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-13T01:21:41.972 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000272817 s, 1.9 MB/s 2026-02-13T01:21:41.975 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T01:21:42.014 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_4 2026-02-13T01:21:42.092 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T01:21:42.093 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:42.093 INFO:teuthology.orchestra.run.trial040.stdout:Device: 6h/6d Inode: 1096 Links: 1 2026-02-13T01:21:42.093 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:42.093 INFO:teuthology.orchestra.run.trial040.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:42.093 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-13 01:21:11.464579751 +0000 2026-02-13T01:21:42.093 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-13 01:19:17.288922060 +0000 2026-02-13T01:21:42.093 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-13 01:19:17.288922060 +0000 2026-02-13T01:21:42.093 INFO:teuthology.orchestra.run.trial040.stdout: Birth: 2026-02-13 01:19:17.288922060 +0000 2026-02-13T01:21:42.094 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T01:21:42.186 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-13T01:21:42.186 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-13T01:21:42.186 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000217905 s, 2.3 MB/s 2026-02-13T01:21:42.188 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T01:21:42.223 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:41 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3736342821' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T01:21:42.223 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.223 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.223 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.224 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:21:42.224 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:21:42.224 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:21:42.224 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:42.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:41 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3736342821' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T01:21:42.225 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.225 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.225 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.225 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:21:42.225 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:21:42.225 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:21:42.225 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.925+0000 7f9630bc8fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.934+0000 7f9630bc8fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.941+0000 7f9630bc8fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.947+0000 7f9630bc8fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.953+0000 7f9630bc8fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.965+0000 7f9630bc8fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.990+0000 7f9630bc8fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.993+0000 7f9630bc8fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:41 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:41.994+0000 7f9630bc8fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:21:42.226 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.001+0000 7f9630bc8fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.038+0000 7f9630bc8fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.040+0000 7f9630bc8fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.044+0000 7f9630bc8fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.046+0000 7f9630bc8fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.046+0000 7f9630bc8fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.049+0000 7f9630bc8fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.050+0000 7f9630bc8fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.053+0000 7f9630bc8fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.055+0000 7f9630bc8fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.223+0000 7f9630bc8fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:21:42.227 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.223+0000 7f9630bc8fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:21:42.229 DEBUG:teuthology.orchestra.run.trial055:> set -ex 2026-02-13T01:21:42.229 DEBUG:teuthology.orchestra.run.trial055:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T01:21:42.247 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T01:21:42.247 DEBUG:teuthology.orchestra.run.trial055:> stat /dev/vg_nvme/lv_1 2026-02-13T01:21:42.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:41 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3736342821' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T01:21:42.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:21:42.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:21:42.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:21:42.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:42.303 INFO:teuthology.orchestra.run.trial055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T01:21:42.303 INFO:teuthology.orchestra.run.trial055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:42.303 INFO:teuthology.orchestra.run.trial055.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-13T01:21:42.303 INFO:teuthology.orchestra.run.trial055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:42.303 INFO:teuthology.orchestra.run.trial055.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:42.303 INFO:teuthology.orchestra.run.trial055.stdout:Access: 2026-02-13 01:21:42.259503380 +0000 2026-02-13T01:21:42.303 INFO:teuthology.orchestra.run.trial055.stdout:Modify: 2026-02-13 01:19:14.482593890 +0000 2026-02-13T01:21:42.304 INFO:teuthology.orchestra.run.trial055.stdout:Change: 2026-02-13 01:19:14.482593890 +0000 2026-02-13T01:21:42.304 INFO:teuthology.orchestra.run.trial055.stdout: Birth: 2026-02-13 01:19:14.482593890 +0000 2026-02-13T01:21:42.304 DEBUG:teuthology.orchestra.run.trial055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T01:21:42.368 INFO:teuthology.orchestra.run.trial055.stderr:1+0 records in 2026-02-13T01:21:42.368 INFO:teuthology.orchestra.run.trial055.stderr:1+0 records out 2026-02-13T01:21:42.368 INFO:teuthology.orchestra.run.trial055.stderr:512 bytes copied, 0.00017782 s, 2.9 MB/s 2026-02-13T01:21:42.370 DEBUG:teuthology.orchestra.run.trial055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T01:21:42.428 DEBUG:teuthology.orchestra.run.trial055:> stat /dev/vg_nvme/lv_2 2026-02-13T01:21:42.484 INFO:teuthology.orchestra.run.trial055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T01:21:42.485 INFO:teuthology.orchestra.run.trial055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:42.485 INFO:teuthology.orchestra.run.trial055.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-13T01:21:42.485 INFO:teuthology.orchestra.run.trial055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:42.485 INFO:teuthology.orchestra.run.trial055.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:42.485 INFO:teuthology.orchestra.run.trial055.stdout:Access: 2026-02-13 01:21:42.259503380 +0000 2026-02-13T01:21:42.485 INFO:teuthology.orchestra.run.trial055.stdout:Modify: 2026-02-13 01:19:14.482593890 +0000 2026-02-13T01:21:42.485 INFO:teuthology.orchestra.run.trial055.stdout:Change: 2026-02-13 01:19:14.482593890 +0000 2026-02-13T01:21:42.485 INFO:teuthology.orchestra.run.trial055.stdout: Birth: 2026-02-13 01:19:14.482593890 +0000 2026-02-13T01:21:42.486 DEBUG:teuthology.orchestra.run.trial055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T01:21:42.504 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.225+0000 7f9630bc8fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:21:42.504 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.228+0000 7f9630bc8fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:21:42.504 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.229+0000 7f9630bc8fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:21:42.504 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.230+0000 7f9630bc8fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:21:42.504 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.230+0000 7f9630bc8fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:21:42.504 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.370+0000 7f9630bc8fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:21:42.504 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.399+0000 7f9630bc8fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:21:42.505 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.403+0000 7f9630bc8fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:21:42.505 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.404+0000 7f9630bc8fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:21:42.505 INFO:journalctl@ceph.mgr.z.trial118.stdout:Feb 13 01:21:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-z[30147]: 2026-02-13T01:21:42.404+0000 7f9630bc8fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:21:42.549 INFO:teuthology.orchestra.run.trial055.stderr:1+0 records in 2026-02-13T01:21:42.550 INFO:teuthology.orchestra.run.trial055.stderr:1+0 records out 2026-02-13T01:21:42.550 INFO:teuthology.orchestra.run.trial055.stderr:512 bytes copied, 0.000138817 s, 3.7 MB/s 2026-02-13T01:21:42.551 DEBUG:teuthology.orchestra.run.trial055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T01:21:42.607 DEBUG:teuthology.orchestra.run.trial055:> stat /dev/vg_nvme/lv_3 2026-02-13T01:21:42.662 INFO:teuthology.orchestra.run.trial055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T01:21:42.662 INFO:teuthology.orchestra.run.trial055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:42.663 INFO:teuthology.orchestra.run.trial055.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-13T01:21:42.663 INFO:teuthology.orchestra.run.trial055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:42.663 INFO:teuthology.orchestra.run.trial055.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:42.663 INFO:teuthology.orchestra.run.trial055.stdout:Access: 2026-02-13 01:21:42.260503361 +0000 2026-02-13T01:21:42.663 INFO:teuthology.orchestra.run.trial055.stdout:Modify: 2026-02-13 01:19:14.483593871 +0000 2026-02-13T01:21:42.663 INFO:teuthology.orchestra.run.trial055.stdout:Change: 2026-02-13 01:19:14.483593871 +0000 2026-02-13T01:21:42.663 INFO:teuthology.orchestra.run.trial055.stdout: Birth: 2026-02-13 01:19:14.483593871 +0000 2026-02-13T01:21:42.664 DEBUG:teuthology.orchestra.run.trial055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T01:21:42.724 INFO:teuthology.orchestra.run.trial055.stderr:1+0 records in 2026-02-13T01:21:42.724 INFO:teuthology.orchestra.run.trial055.stderr:1+0 records out 2026-02-13T01:21:42.724 INFO:teuthology.orchestra.run.trial055.stderr:512 bytes copied, 0.000240396 s, 2.1 MB/s 2026-02-13T01:21:42.726 DEBUG:teuthology.orchestra.run.trial055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T01:21:42.783 DEBUG:teuthology.orchestra.run.trial055:> stat /dev/vg_nvme/lv_4 2026-02-13T01:21:42.840 INFO:teuthology.orchestra.run.trial055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T01:21:42.841 INFO:teuthology.orchestra.run.trial055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:42.841 INFO:teuthology.orchestra.run.trial055.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-13T01:21:42.841 INFO:teuthology.orchestra.run.trial055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:42.841 INFO:teuthology.orchestra.run.trial055.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:42.841 INFO:teuthology.orchestra.run.trial055.stdout:Access: 2026-02-13 01:21:42.260503361 +0000 2026-02-13T01:21:42.841 INFO:teuthology.orchestra.run.trial055.stdout:Modify: 2026-02-13 01:19:14.482593890 +0000 2026-02-13T01:21:42.841 INFO:teuthology.orchestra.run.trial055.stdout:Change: 2026-02-13 01:19:14.482593890 +0000 2026-02-13T01:21:42.841 INFO:teuthology.orchestra.run.trial055.stdout: Birth: 2026-02-13 01:19:14.482593890 +0000 2026-02-13T01:21:42.842 DEBUG:teuthology.orchestra.run.trial055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T01:21:42.905 INFO:teuthology.orchestra.run.trial055.stderr:1+0 records in 2026-02-13T01:21:42.906 INFO:teuthology.orchestra.run.trial055.stderr:1+0 records out 2026-02-13T01:21:42.906 INFO:teuthology.orchestra.run.trial055.stderr:512 bytes copied, 0.00023151 s, 2.2 MB/s 2026-02-13T01:21:42.907 DEBUG:teuthology.orchestra.run.trial055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T01:21:42.964 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-13T01:21:42.964 DEBUG:teuthology.orchestra.run.trial118:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T01:21:42.982 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T01:21:42.983 DEBUG:teuthology.orchestra.run.trial118:> stat /dev/vg_nvme/lv_1 2026-02-13T01:21:42.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:42 trial055 ceph-mon[27509]: Standby manager daemon z started 2026-02-13T01:21:42.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:42.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:43.039 INFO:teuthology.orchestra.run.trial118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T01:21:43.040 INFO:teuthology.orchestra.run.trial118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:43.040 INFO:teuthology.orchestra.run.trial118.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-13T01:21:43.040 INFO:teuthology.orchestra.run.trial118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:43.040 INFO:teuthology.orchestra.run.trial118.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:43.040 INFO:teuthology.orchestra.run.trial118.stdout:Access: 2026-02-13 01:21:41.446307312 +0000 2026-02-13T01:21:43.040 INFO:teuthology.orchestra.run.trial118.stdout:Modify: 2026-02-13 01:19:16.333234004 +0000 2026-02-13T01:21:43.040 INFO:teuthology.orchestra.run.trial118.stdout:Change: 2026-02-13 01:19:16.333234004 +0000 2026-02-13T01:21:43.040 INFO:teuthology.orchestra.run.trial118.stdout: Birth: 2026-02-13 01:19:16.333234004 +0000 2026-02-13T01:21:43.041 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T01:21:43.105 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records in 2026-02-13T01:21:43.106 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records out 2026-02-13T01:21:43.106 INFO:teuthology.orchestra.run.trial118.stderr:512 bytes copied, 0.000156731 s, 3.3 MB/s 2026-02-13T01:21:43.107 DEBUG:teuthology.orchestra.run.trial118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T01:21:43.165 DEBUG:teuthology.orchestra.run.trial118:> stat /dev/vg_nvme/lv_2 2026-02-13T01:21:43.222 INFO:teuthology.orchestra.run.trial118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T01:21:43.222 INFO:teuthology.orchestra.run.trial118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:43.222 INFO:teuthology.orchestra.run.trial118.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-13T01:21:43.222 INFO:teuthology.orchestra.run.trial118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:43.222 INFO:teuthology.orchestra.run.trial118.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:43.222 INFO:teuthology.orchestra.run.trial118.stdout:Access: 2026-02-13 01:21:41.446307312 +0000 2026-02-13T01:21:43.222 INFO:teuthology.orchestra.run.trial118.stdout:Modify: 2026-02-13 01:19:16.333234004 +0000 2026-02-13T01:21:43.222 INFO:teuthology.orchestra.run.trial118.stdout:Change: 2026-02-13 01:19:16.333234004 +0000 2026-02-13T01:21:43.222 INFO:teuthology.orchestra.run.trial118.stdout: Birth: 2026-02-13 01:19:16.333234004 +0000 2026-02-13T01:21:43.223 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T01:21:43.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:42 trial040 ceph-mon[23046]: Standby manager daemon z started 2026-02-13T01:21:43.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:43.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:43.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:43.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:43.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:43.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:42 trial118 ceph-mon[27812]: Standby manager daemon z started 2026-02-13T01:21:43.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:43.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:43.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:43.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:43.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:43.276 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records in 2026-02-13T01:21:43.277 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records out 2026-02-13T01:21:43.277 INFO:teuthology.orchestra.run.trial118.stderr:512 bytes copied, 0.000160248 s, 3.2 MB/s 2026-02-13T01:21:43.278 DEBUG:teuthology.orchestra.run.trial118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T01:21:43.336 DEBUG:teuthology.orchestra.run.trial118:> stat /dev/vg_nvme/lv_3 2026-02-13T01:21:43.392 INFO:teuthology.orchestra.run.trial118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T01:21:43.392 INFO:teuthology.orchestra.run.trial118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:43.392 INFO:teuthology.orchestra.run.trial118.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-13T01:21:43.392 INFO:teuthology.orchestra.run.trial118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:43.392 INFO:teuthology.orchestra.run.trial118.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:43.392 INFO:teuthology.orchestra.run.trial118.stdout:Access: 2026-02-13 01:21:41.447307297 +0000 2026-02-13T01:21:43.393 INFO:teuthology.orchestra.run.trial118.stdout:Modify: 2026-02-13 01:19:16.334233988 +0000 2026-02-13T01:21:43.393 INFO:teuthology.orchestra.run.trial118.stdout:Change: 2026-02-13 01:19:16.334233988 +0000 2026-02-13T01:21:43.393 INFO:teuthology.orchestra.run.trial118.stdout: Birth: 2026-02-13 01:19:16.334233988 +0000 2026-02-13T01:21:43.393 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T01:21:43.455 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records in 2026-02-13T01:21:43.456 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records out 2026-02-13T01:21:43.456 INFO:teuthology.orchestra.run.trial118.stderr:512 bytes copied, 0.000249824 s, 2.0 MB/s 2026-02-13T01:21:43.457 DEBUG:teuthology.orchestra.run.trial118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T01:21:43.492 INFO:journalctl@ceph.mgr.y.trial055.stdout:Feb 13 01:21:43 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-y[29657]: 2026-02-13T01:21:43.251+0000 7f998c106fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:21:43.515 DEBUG:teuthology.orchestra.run.trial118:> stat /dev/vg_nvme/lv_4 2026-02-13T01:21:43.571 INFO:teuthology.orchestra.run.trial118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T01:21:43.571 INFO:teuthology.orchestra.run.trial118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:21:43.572 INFO:teuthology.orchestra.run.trial118.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-13T01:21:43.572 INFO:teuthology.orchestra.run.trial118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:21:43.572 INFO:teuthology.orchestra.run.trial118.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:21:43.572 INFO:teuthology.orchestra.run.trial118.stdout:Access: 2026-02-13 01:21:41.447307297 +0000 2026-02-13T01:21:43.572 INFO:teuthology.orchestra.run.trial118.stdout:Modify: 2026-02-13 01:19:16.333234004 +0000 2026-02-13T01:21:43.572 INFO:teuthology.orchestra.run.trial118.stdout:Change: 2026-02-13 01:19:16.333234004 +0000 2026-02-13T01:21:43.572 INFO:teuthology.orchestra.run.trial118.stdout: Birth: 2026-02-13 01:19:16.333234004 +0000 2026-02-13T01:21:43.573 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T01:21:43.634 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records in 2026-02-13T01:21:43.634 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records out 2026-02-13T01:21:43.634 INFO:teuthology.orchestra.run.trial118.stderr:512 bytes copied, 0.000213287 s, 2.4 MB/s 2026-02-13T01:21:43.636 DEBUG:teuthology.orchestra.run.trial118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T01:21:43.692 INFO:tasks.cephadm:Deploying osd.0 on trial040 with /dev/vg_nvme/lv_4... 2026-02-13T01:21:43.692 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T01:21:43.880 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:44.200 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: mgrmap e13: x(active, since 7s), standbys: z 2026-02-13T01:21:44.200 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T01:21:44.200 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.200 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.200 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: Standby manager daemon y started 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.201 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: mgrmap e13: x(active, since 7s), standbys: z 2026-02-13T01:21:44.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T01:21:44.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:44.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:44.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:21:44.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:21:44.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:44.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: Standby manager daemon y started 2026-02-13T01:21:44.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: mgrmap e13: x(active, since 7s), standbys: z 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:21:44.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:21:44.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:44.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: Standby manager daemon y started 2026-02-13T01:21:44.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:44.767 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:21:44.789 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial040:vg_nvme/lv_4 --skip-validation 2026-02-13T01:21:44.975 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:21:45.105 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:45.106 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:45.106 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:45.106 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:45.106 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:44 trial040 ceph-mon[23046]: mgrmap e14: x(active, since 8s), standbys: z, y 2026-02-13T01:21:45.106 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T01:21:45.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.172+0000 7f219608b6c0 1 -- 10.20.193.40:0/332524223 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 msgr2=0x7f219017a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:45.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.172+0000 7f219608b6c0 1 --2- 10.20.193.40:0/332524223 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 0x7f219017a100 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=8514087100272836490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f218c00aa70 tx=0x7f218c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:21:45.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.172+0000 7f219608b6c0 1 -- 10.20.193.40:0/332524223 shutdown_connections 2026-02-13T01:21:45.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.172+0000 7f219608b6c0 1 --2- 10.20.193.40:0/332524223 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 0x7f219017a100 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=8514087100272836490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:45.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.172+0000 7f219608b6c0 1 --2- 10.20.193.40:0/332524223 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2190114190 0x7f2190115d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:45.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.172+0000 7f219608b6c0 1 --2- 10.20.193.40:0/332524223 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f21901137a0 0x7f2190113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:45.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.172+0000 7f219608b6c0 1 -- 10.20.193.40:0/332524223 >> 10.20.193.40:0/332524223 conn(0x7f2190061510 msgr2=0x7f2190061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:45.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.172+0000 7f219608b6c0 1 -- 10.20.193.40:0/332524223 shutdown_connections 2026-02-13T01:21:45.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.172+0000 7f219608b6c0 1 -- 10.20.193.40:0/332524223 wait complete. 2026-02-13T01:21:45.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f219608b6c0 1 Processor -- start 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f219608b6c0 1 -- start start 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f219608b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21901137a0 0x7f21901212b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f219608b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 0x7f21901217f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f219608b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2190126b60 0x7f2190127000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f219608b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2190127570 con 0x7f2190116520 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f219608b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f21901276e0 con 0x7f21901137a0 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f219608b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21901278a0 con 0x7f2190126b60 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f21948886c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 0x7f21901217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f21948886c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 0x7f21901217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:36842/0 (socket says 10.20.193.40:36842) 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f21948886c0 1 -- 10.20.193.40:0/314300210 learned_addr learned my addr 10.20.193.40:0/314300210 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:21:45.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f21950896c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21901137a0 0x7f21901212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f219588a6c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2190126b60 0x7f2190127000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.173+0000 7f21948886c0 1 -- 10.20.193.40:0/314300210 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2190126b60 msgr2=0x7f2190127000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f21948886c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2190126b60 0x7f2190127000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f21948886c0 1 -- 10.20.193.40:0/314300210 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21901137a0 msgr2=0x7f21901212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f21948886c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21901137a0 0x7f21901212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f21948886c0 1 -- 10.20.193.40:0/314300210 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218c00a660 con 0x7f2190116520 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f21950896c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21901137a0 0x7f21901212b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f219588a6c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2190126b60 0x7f2190127000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f21948886c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 0x7f21901217f0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2184005fd0 tx=0x7f218400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f217e7fc6c0 1 -- 10.20.193.40:0/314300210 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2184004280 con 0x7f2190116520 2026-02-13T01:21:45.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f217e7fc6c0 1 -- 10.20.193.40:0/314300210 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f21840043e0 con 0x7f2190116520 2026-02-13T01:21:45.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f217e7fc6c0 1 -- 10.20.193.40:0/314300210 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21840072a0 con 0x7f2190116520 2026-02-13T01:21:45.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2190167d50 con 0x7f2190116520 2026-02-13T01:21:45.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21901681e0 con 0x7f2190116520 2026-02-13T01:21:45.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.174+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2190114840 con 0x7f2190116520 2026-02-13T01:21:45.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.177+0000 7f217e7fc6c0 1 -- 10.20.193.40:0/314300210 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f218400c4d0 con 0x7f2190116520 2026-02-13T01:21:45.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.179+0000 7f217e7fc6c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f216c0b5640 0x7f216c0d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:45.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.179+0000 7f217e7fc6c0 1 -- 10.20.193.40:0/314300210 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f21840e1e90 con 0x7f2190116520 2026-02-13T01:21:45.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.179+0000 7f217e7fc6c0 1 -- 10.20.193.40:0/314300210 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f21840e22c0 con 0x7f2190116520 2026-02-13T01:21:45.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.179+0000 7f21950896c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f216c0b5640 0x7f216c0d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:45.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.179+0000 7f21950896c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f216c0b5640 0x7f216c0d5af0 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2180004750 tx=0x7f2180009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:45.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:45.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:45.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:45.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:45.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:44 trial055 ceph-mon[27509]: mgrmap e14: x(active, since 8s), standbys: z, y 2026-02-13T01:21:45.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T01:21:45.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:45.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:45.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:45.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:45.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:44 trial118 ceph-mon[27812]: mgrmap e14: x(active, since 8s), standbys: z, y 2026-02-13T01:21:45.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T01:21:45.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:45.284+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f2190122410 con 0x7f216c0b5640 2026-02-13T01:21:46.581 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:46.581 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.581 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.581 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:46.581 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:46.581 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:46.581 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.581 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:46.581 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.582 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:46.582 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:46.582 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.582 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:46.582 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:46.582 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:46.582 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:46.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:46.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:46.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:46.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:46.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:46.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:46.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:46.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:46.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:46.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:46.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:46.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:46.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:46.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:46.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:46.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:47.550 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:47 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1059412685' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d6fb8271-19fd-4149-91ec-ed412cd5dc02"} : dispatch 2026-02-13T01:21:47.550 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:47 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1059412685' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6fb8271-19fd-4149-91ec-ed412cd5dc02"}]': finished 2026-02-13T01:21:47.551 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:47 trial040 ceph-mon[23046]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T01:21:47.551 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:47.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:47 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1059412685' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d6fb8271-19fd-4149-91ec-ed412cd5dc02"} : dispatch 2026-02-13T01:21:47.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:47 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1059412685' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6fb8271-19fd-4149-91ec-ed412cd5dc02"}]': finished 2026-02-13T01:21:47.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:47 trial055 ceph-mon[27509]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T01:21:47.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:47.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:47 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1059412685' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d6fb8271-19fd-4149-91ec-ed412cd5dc02"} : dispatch 2026-02-13T01:21:47.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:47 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1059412685' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6fb8271-19fd-4149-91ec-ed412cd5dc02"}]': finished 2026-02-13T01:21:47.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:47 trial118 ceph-mon[27812]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T01:21:47.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:48.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:48 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4069647635' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:21:48.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:48 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4069647635' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:21:48.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:48 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4069647635' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:21:50.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T01:21:50.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:50.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T01:21:50.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:51.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T01:21:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:53.898 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:53.899 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:53.899 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:53.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:53.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:53.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:54.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:54.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:54.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:55.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.108+0000 7f217e7fc6c0 1 -- 10.20.193.40:0/314300210 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f2190122410 con 0x7f216c0b5640 2026-02-13T01:21:55.110 INFO:teuthology.orchestra.run.trial040.stdout:Created osd(s) 0 on host 'trial040' 2026-02-13T01:21:55.111 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.110+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f216c0b5640 msgr2=0x7f216c0d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:55.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.110+0000 7f219608b6c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f216c0b5640 0x7f216c0d5af0 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2180004750 tx=0x7f2180009260 comp rx=0 tx=0).stop 2026-02-13T01:21:55.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.110+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 msgr2=0x7f21901217f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:55.112 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.110+0000 7f219608b6c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 0x7f21901217f0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2184005fd0 tx=0x7f218400bca0 comp rx=0 tx=0).stop 2026-02-13T01:21:55.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.111+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 shutdown_connections 2026-02-13T01:21:55.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.111+0000 7f219608b6c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f216c0b5640 0x7f216c0d5af0 unknown :-1 s=CLOSED pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:55.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.111+0000 7f219608b6c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2190126b60 0x7f2190127000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:55.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.111+0000 7f219608b6c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2190116520 0x7f21901217f0 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:55.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.111+0000 7f219608b6c0 1 --2- 10.20.193.40:0/314300210 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21901137a0 0x7f21901212b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:55.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.111+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 >> 10.20.193.40:0/314300210 conn(0x7f2190061510 msgr2=0x7f2190115520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:55.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.111+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 shutdown_connections 2026-02-13T01:21:55.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:21:55.111+0000 7f219608b6c0 1 -- 10.20.193.40:0/314300210 wait complete. 2026-02-13T01:21:55.218 DEBUG:teuthology.orchestra.run.trial040:osd.0> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.0.service 2026-02-13T01:21:55.223 INFO:tasks.cephadm:Deploying osd.1 on trial055 with /dev/vg_nvme/lv_4... 2026-02-13T01:21:55.224 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T01:21:55.343 INFO:teuthology.orchestra.run.trial055.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.b/config 2026-02-13T01:21:55.786 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:21:55.803 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial055:vg_nvme/lv_4 --skip-validation 2026-02-13T01:21:55.805 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:55.806 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:55.919 INFO:teuthology.orchestra.run.trial055.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.b/config 2026-02-13T01:21:55.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:55.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:55.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:55.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:55.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:55.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:55.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:56.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:56.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:21:56.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:56.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:56.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:56.038 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 -- 10.20.193.55:0/1102183322 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f214010fbf0 msgr2=0x7f2140114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:56.038 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1102183322 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f214010fbf0 0x7f2140114c30 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=16675883402018347017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2124009970 tx=0x7f212402ed20 comp rx=0 tx=0).stop 2026-02-13T01:21:56.038 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 -- 10.20.193.55:0/1102183322 shutdown_connections 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1102183322 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2140115410 0x7f2140175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1102183322 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f214010fbf0 0x7f2140114c30 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=16675883402018347017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1102183322 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f214010f200 0x7f214010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 -- 10.20.193.55:0/1102183322 >> 10.20.193.55:0/1102183322 conn(0x7f21400ecb00 msgr2=0x7f214010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 -- 10.20.193.55:0/1102183322 shutdown_connections 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 -- 10.20.193.55:0/1102183322 wait complete. 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 Processor -- start 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 -- start start 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f214010f200 0x7f21400f49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2140115410 0x7f2140175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:56.039 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21400f5000 0x7f21400fa2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f21400f56f0 con 0x7f2140115410 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f21400fa810 con 0x7f21400f5000 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f2144d106c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21400fa9d0 con 0x7f214010f200 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213ed766c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21400f5000 0x7f21400fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213ed766c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21400f5000 0x7f21400fa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.55:40296/0 (socket says 10.20.193.55:40296) 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213ed766c0 1 -- 10.20.193.55:0/1822279034 learned_addr learned my addr 10.20.193.55:0/1822279034 (peer_addr_for_me v2:10.20.193.55:0/0) 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213dd746c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2140115410 0x7f2140175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213ed766c0 1 -- 10.20.193.55:0/1822279034 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f214010f200 msgr2=0x7f21400f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213ed766c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f214010f200 0x7f21400f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213ed766c0 1 -- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2140115410 msgr2=0x7f2140175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213ed766c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2140115410 0x7f2140175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:21:56.040 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213ed766c0 1 -- 10.20.193.55:0/1822279034 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2124009590 con 0x7f21400f5000 2026-02-13T01:21:56.041 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.034+0000 7f213dd746c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2140115410 0x7f2140175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:21:56.041 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.035+0000 7f213ed766c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21400f5000 0x7f21400fa2d0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f213000c800 tx=0x7f213000ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:56.041 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.035+0000 7f21377fe6c0 1 -- 10.20.193.55:0/1822279034 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2130003a30 con 0x7f21400f5000 2026-02-13T01:21:56.041 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.035+0000 7f21377fe6c0 1 -- 10.20.193.55:0/1822279034 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2130005560 con 0x7f21400f5000 2026-02-13T01:21:56.041 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.035+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21400facb0 con 0x7f21400f5000 2026-02-13T01:21:56.041 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.035+0000 7f21377fe6c0 1 -- 10.20.193.55:0/1822279034 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f213000de80 con 0x7f21400f5000 2026-02-13T01:21:56.041 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.035+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21400fb440 con 0x7f21400f5000 2026-02-13T01:21:56.041 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.035+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21401104d0 con 0x7f21400f5000 2026-02-13T01:21:56.042 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.036+0000 7f21377fe6c0 1 -- 10.20.193.55:0/1822279034 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f2130003b90 con 0x7f21400f5000 2026-02-13T01:21:56.042 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.037+0000 7f21377fe6c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21080b5630 0x7f21080d5ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:21:56.043 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.037+0000 7f21377fe6c0 1 -- 10.20.193.55:0/1822279034 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1356+0+0 (secure 0 0 0) 0x7f21300e3000 con 0x7f21400f5000 2026-02-13T01:21:56.043 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.037+0000 7f213e5756c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21080b5630 0x7f21080d5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:21:56.043 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.038+0000 7f21377fe6c0 1 -- 10.20.193.55:0/1822279034 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f21300a7570 con 0x7f21400f5000 2026-02-13T01:21:56.043 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.038+0000 7f213e5756c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21080b5630 0x7f21080d5ae0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f212c004750 tx=0x7f212c0096a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:21:56.136 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:21:56.134+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f2140052a50 con 0x7f21080b5630 2026-02-13T01:21:56.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T01:21:56.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T01:21:56.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:21:56.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:56.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:56.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:56.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:56.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:56.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:56.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:56 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:56.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T01:21:56.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T01:21:56.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:21:56.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:57.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:57.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:57.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:57.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:57.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:57.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:56 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:57.000 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:21:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0[35887]: 2026-02-13T01:21:56.650+0000 7fbb921766c0 -1 osd.0 0 waiting for initial osdmap 2026-02-13T01:21:57.001 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:21:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0[35887]: 2026-02-13T01:21:56.653+0000 7fbb8e03a6c0 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:21:57.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T01:21:57.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T01:21:57.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:21:57.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:57.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:57.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:57.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:57.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:57.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:57.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:56 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:21:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T01:21:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='client.? 10.20.193.55:0/3519411292' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3d8d3277-423d-455b-af0d-67d15aaea487"} : dispatch 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3d8d3277-423d-455b-af0d-67d15aaea487"} : dispatch 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d8d3277-423d-455b-af0d-67d15aaea487"}]': finished 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] boot 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:57.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:57.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:57.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:57.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:57.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:57.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:57.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:57.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:57.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:57 trial055 ceph-mon[27509]: from='client.? 10.20.193.55:0/2214289377' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:21:57.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:57.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:21:57.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T01:21:57.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:57.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:57.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='client.? 10.20.193.55:0/3519411292' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3d8d3277-423d-455b-af0d-67d15aaea487"} : dispatch 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3d8d3277-423d-455b-af0d-67d15aaea487"} : dispatch 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d8d3277-423d-455b-af0d-67d15aaea487"}]': finished 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] boot 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:58.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:58.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:58.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:58.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:58.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:58.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:57 trial040 ceph-mon[23046]: from='client.? 10.20.193.55:0/2214289377' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='client.? 10.20.193.55:0/3519411292' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3d8d3277-423d-455b-af0d-67d15aaea487"} : dispatch 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3d8d3277-423d-455b-af0d-67d15aaea487"} : dispatch 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d8d3277-423d-455b-af0d-67d15aaea487"}]': finished 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: osd.0 [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] boot 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T01:21:58.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:58.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:57 trial118 ceph-mon[27812]: from='client.? 10.20.193.55:0/2214289377' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:21:58.904 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:58 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:21:58.904 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:58 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:21:58.904 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:58 trial055 ceph-mon[27509]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:58.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:58 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:21:58.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:58 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:21:58.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:58 trial040 ceph-mon[23046]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:59.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:58 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:21:59.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:58 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:21:59.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:58 trial118 ceph-mon[27812]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:21:59.712 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T01:21:59.712 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:21:59.712 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: pgmap v9: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T01:21:59.713 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:21:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:59.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: pgmap v9: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T01:21:59.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:21:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: pgmap v9: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:00.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:00.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T01:22:00.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:21:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:00.929 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:00 trial055 ceph-mon[27509]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:00.929 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:00 trial055 ceph-mon[27509]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:00.929 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:00 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:00.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:00 trial040 ceph-mon[23046]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:00.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:00 trial040 ceph-mon[23046]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:00.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:00 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:01.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:00 trial118 ceph-mon[27812]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:01.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:00 trial118 ceph-mon[27812]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:01.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:00 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:01.982 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:01 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:01.982 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:01 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:01.982 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:01 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:01.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:01 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:01.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:01 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:01.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:01 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:01 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:02.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:01 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:01 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.130 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.128+0000 7f21377fe6c0 1 -- 10.20.193.55:0/1822279034 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f2140052a50 con 0x7f21080b5630 2026-02-13T01:22:02.130 INFO:teuthology.orchestra.run.trial055.stdout:Created osd(s) 1 on host 'trial055' 2026-02-13T01:22:02.133 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.130+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21080b5630 msgr2=0x7f21080d5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.130+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21080b5630 0x7f21080d5ae0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f212c004750 tx=0x7f212c0096a0 comp rx=0 tx=0).stop 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.130+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21400f5000 msgr2=0x7f21400fa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.130+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21400f5000 0x7f21400fa2d0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f213000c800 tx=0x7f213000ccd0 comp rx=0 tx=0).stop 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.131+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 shutdown_connections 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.131+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21080b5630 0x7f21080d5ae0 unknown :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.131+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21400f5000 0x7f21400fa2d0 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.131+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2140115410 0x7f2140175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.131+0000 7f2144d106c0 1 --2- 10.20.193.55:0/1822279034 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f214010f200 0x7f21400f49d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.131+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 >> 10.20.193.55:0/1822279034 conn(0x7f21400ecb00 msgr2=0x7f214010d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:02.134 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.131+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 shutdown_connections 2026-02-13T01:22:02.135 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:02.131+0000 7f2144d106c0 1 -- 10.20.193.55:0/1822279034 wait complete. 2026-02-13T01:22:02.173 DEBUG:teuthology.orchestra.run.trial055:osd.1> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.1.service 2026-02-13T01:22:02.216 INFO:tasks.cephadm:Deploying osd.2 on trial118 with /dev/vg_nvme/lv_4... 2026-02-13T01:22:02.217 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T01:22:02.333 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:22:02.748 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:02.748 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='osd.1 [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:22:02.749 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:02.750 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:02.750 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.750 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.750 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:02.796 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:22:02.813 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial118:vg_nvme/lv_4 --skip-validation 2026-02-13T01:22:02.929 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:22:02.954 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:02.955 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='osd.1 [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:22:02.956 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:22:02.956 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:02.956 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:02.956 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.956 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.956 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='osd.1 [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:22:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:22:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:03.048 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.043+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/1990683944 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 msgr2=0x7ff15c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:03.048 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.043+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/1990683944 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 0x7ff15c10f600 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=16135357029007531836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1480099a0 tx=0x7ff14802ed20 comp rx=0 tx=0).stop 2026-02-13T01:22:03.048 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/1990683944 shutdown_connections 2026-02-13T01:22:03.048 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/1990683944 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff15c115440 0x7ff15c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/1990683944 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff15c10fc20 0x7ff15c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/1990683944 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 0x7ff15c10f600 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=16135357029007531836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/1990683944 >> 10.20.193.118:0/1990683944 conn(0x7ff15c0ecb30 msgr2=0x7ff15c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/1990683944 shutdown_connections 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/1990683944 wait complete. 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 Processor -- start 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 -- start start 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 0x7ff15c11d020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff15c115440 0x7ff15c11d560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff15c122920 0x7ff15c122dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c123330 con 0x7ff15c122920 2026-02-13T01:22:03.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c1234a0 con 0x7ff15c115440 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff163e8d6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c123660 con 0x7ff15c10f230 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff161bfe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 0x7ff15c11d020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff161bfe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 0x7ff15c11d020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.118:58250/0 (socket says 10.20.193.118:58250) 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff161bfe6c0 1 -- 10.20.193.118:0/2970804917 learned_addr learned my addr 10.20.193.118:0/2970804917 (peer_addr_for_me v2:10.20.193.118:0/0) 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff1613fd6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff15c115440 0x7ff15c11d560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff161bfe6c0 1 -- 10.20.193.118:0/2970804917 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff15c115440 msgr2=0x7ff15c11d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff161bfe6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff15c115440 0x7ff15c11d560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff161bfe6c0 1 -- 10.20.193.118:0/2970804917 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff15c122920 msgr2=0x7ff15c122dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff161bfe6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff15c122920 0x7ff15c122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff161bfe6c0 1 -- 10.20.193.118:0/2970804917 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff148009590 con 0x7ff15c10f230 2026-02-13T01:22:03.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff161bfe6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 0x7ff15c11d020 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1480098c0 tx=0x7ff14802f830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:03.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff15affd6c0 1 -- 10.20.193.118:0/2970804917 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1480026b0 con 0x7ff15c10f230 2026-02-13T01:22:03.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.044+0000 7ff15affd6c0 1 -- 10.20.193.118:0/2970804917 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff148002d40 con 0x7ff15c10f230 2026-02-13T01:22:03.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.045+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15c163ab0 con 0x7ff15c10f230 2026-02-13T01:22:03.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.045+0000 7ff15affd6c0 1 -- 10.20.193.118:0/2970804917 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff148007670 con 0x7ff15c10f230 2026-02-13T01:22:03.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.045+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff15c163ee0 con 0x7ff15c10f230 2026-02-13T01:22:03.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.045+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff15c110500 con 0x7ff15c10f230 2026-02-13T01:22:03.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.046+0000 7ff15affd6c0 1 -- 10.20.193.118:0/2970804917 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7ff148002810 con 0x7ff15c10f230 2026-02-13T01:22:03.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.047+0000 7ff15affd6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1240b55c0 0x7ff1240d5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:03.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.047+0000 7ff15affd6c0 1 -- 10.20.193.118:0/2970804917 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1896+0+0 (secure 0 0 0) 0x7ff148106580 con 0x7ff15c10f230 2026-02-13T01:22:03.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.047+0000 7ff1613fd6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1240b55c0 0x7ff1240d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:03.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.048+0000 7ff1613fd6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1240b55c0 0x7ff1240d5a70 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff144006b60 tx=0x7ff144006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:03.053 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.048+0000 7ff15affd6c0 1 -- 10.20.193.118:0/2970804917 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff1480ca8d0 con 0x7ff15c10f230 2026-02-13T01:22:03.146 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:03.144+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7ff15c10fc20 con 0x7ff1240b55c0 2026-02-13T01:22:03.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:03.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T01:22:03.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='osd.1 [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:03.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T01:22:03.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:03.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:03.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:03.756 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.756 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:03.756 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:03.756 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:03.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:03.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T01:22:03.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='osd.1 [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:03.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T01:22:03.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:03.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:03.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:03.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:03.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:03.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:03.994 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:03 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1[33337]: 2026-02-13T01:22:03.680+0000 7f9ac62f66c0 -1 osd.1 0 waiting for initial osdmap 2026-02-13T01:22:03.994 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:03 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1[33337]: 2026-02-13T01:22:03.682+0000 7f9abe1b26c0 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='osd.1 [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:04.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:04.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:04.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: pgmap v16: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:04.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:22:04.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T01:22:04.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:04.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:04.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='client.? 10.20.193.118:0/1583199384' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d84270b-3934-48db-99a7-d6b8845c344d"} : dispatch 2026-02-13T01:22:04.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d84270b-3934-48db-99a7-d6b8845c344d"} : dispatch 2026-02-13T01:22:04.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d84270b-3934-48db-99a7-d6b8845c344d"}]': finished 2026-02-13T01:22:04.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: osd.1 [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] boot 2026-02-13T01:22:04.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T01:22:04.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:04.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:04.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: from='client.? 10.20.193.118:0/2046767148' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:04.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:04.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:04 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: pgmap v16: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:22:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T01:22:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/1583199384' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d84270b-3934-48db-99a7-d6b8845c344d"} : dispatch 2026-02-13T01:22:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d84270b-3934-48db-99a7-d6b8845c344d"} : dispatch 2026-02-13T01:22:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d84270b-3934-48db-99a7-d6b8845c344d"}]': finished 2026-02-13T01:22:05.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: osd.1 [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] boot 2026-02-13T01:22:05.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T01:22:05.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:05.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:05.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/2046767148' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:05.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:05.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:04 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:05.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:05.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: pgmap v16: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:22:05.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:22:05.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T01:22:05.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:05.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:05.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='client.? 10.20.193.118:0/1583199384' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d84270b-3934-48db-99a7-d6b8845c344d"} : dispatch 2026-02-13T01:22:05.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d84270b-3934-48db-99a7-d6b8845c344d"} : dispatch 2026-02-13T01:22:05.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d84270b-3934-48db-99a7-d6b8845c344d"}]': finished 2026-02-13T01:22:05.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: osd.1 [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] boot 2026-02-13T01:22:05.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T01:22:05.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:22:05.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:05.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: from='client.? 10.20.193.118:0/2046767148' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:05.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:05.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:04 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:06.173 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:22:06.173 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:22:06.173 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:06.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:05 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:06.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:06.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:06.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:06.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:05 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:06.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:06.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:06.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:05 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:07.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:06 trial055 ceph-mon[27509]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:07.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:06 trial055 ceph-mon[27509]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:07.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:06 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T01:22:07.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:06 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:07.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:06 trial055 ceph-mon[27509]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:07.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:06 trial040 ceph-mon[23046]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:07.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:06 trial040 ceph-mon[23046]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:07.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:06 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T01:22:07.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:06 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:07.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:06 trial040 ceph-mon[23046]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:07.250 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:06 trial118 ceph-mon[27812]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:07.250 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:06 trial118 ceph-mon[27812]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:07.250 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:06 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T01:22:07.250 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:06 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:07.250 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:06 trial118 ceph-mon[27812]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:08.210 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:07 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:08.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:07 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:08.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:07 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:09.223 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:09.223 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:09.224 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:09.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:09.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:09.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:09.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:09.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:09.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:09.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:09.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:09.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:09.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:09.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:09.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:09.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:09.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:09.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:09.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:09.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:09.272 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.270+0000 7ff15affd6c0 1 -- 10.20.193.118:0/2970804917 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7ff15c10fc20 con 0x7ff1240b55c0 2026-02-13T01:22:09.273 INFO:teuthology.orchestra.run.trial118.stdout:Created osd(s) 2 on host 'trial118' 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1240b55c0 msgr2=0x7ff1240d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1240b55c0 0x7ff1240d5a70 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff144006b60 tx=0x7ff144006af0 comp rx=0 tx=0).stop 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 msgr2=0x7ff15c11d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 0x7ff15c11d020 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1480098c0 tx=0x7ff14802f830 comp rx=0 tx=0).stop 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 shutdown_connections 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1240b55c0 0x7ff1240d5a70 unknown :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff15c122920 0x7ff15c122dc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff15c115440 0x7ff15c11d560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 --2- 10.20.193.118:0/2970804917 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff15c10f230 0x7ff15c11d020 unknown :-1 s=CLOSED pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 >> 10.20.193.118:0/2970804917 conn(0x7ff15c0ecb30 msgr2=0x7ff15c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 shutdown_connections 2026-02-13T01:22:09.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:09.273+0000 7ff163e8d6c0 1 -- 10.20.193.118:0/2970804917 wait complete. 2026-02-13T01:22:09.334 DEBUG:teuthology.orchestra.run.trial118:osd.2> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.2.service 2026-02-13T01:22:09.335 INFO:tasks.cephadm:Deploying osd.3 on trial040 with /dev/vg_nvme/lv_3... 2026-02-13T01:22:09.335 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T01:22:09.522 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:22:10.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:09 trial055 ceph-mon[27509]: from='osd.2 [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:22:10.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:09 trial055 ceph-mon[27509]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:22:10.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:09 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:10.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:09 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:10.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:09 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:10.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:09 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:10.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:09 trial055 ceph-mon[27509]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:10.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:09 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:10.243 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:09 trial040 ceph-mon[23046]: from='osd.2 [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:22:10.243 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:09 trial040 ceph-mon[23046]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:22:10.243 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:09 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:10.243 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:09 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:10.244 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:09 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:10.244 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:09 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:10.244 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:09 trial040 ceph-mon[23046]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:10.244 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:09 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:10.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:09 trial118 ceph-mon[27812]: from='osd.2 [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:22:10.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:09 trial118 ceph-mon[27812]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:22:10.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:09 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:10.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:09 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:10.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:09 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:10.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:09 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:10.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:09 trial118 ceph-mon[27812]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:10.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:09 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:10.358 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:22:10.385 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial040:vg_nvme/lv_3 --skip-validation 2026-02-13T01:22:10.572 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:22:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.780+0000 7fa45e5746c0 1 -- 10.20.193.40:0/4030529549 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4581198f0 msgr2=0x7fa45817a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.780+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/4030529549 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4581198f0 0x7fa45817a2c0 secure :-1 s=READY pgs=40 gs=2 cs=0 l=1 c_cookie=11631036053802042763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa44c00aa40 tx=0x7fa44c02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:22:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.780+0000 7fa45e5746c0 1 -- 10.20.193.40:0/4030529549 shutdown_connections 2026-02-13T01:22:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.780+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/4030529549 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4581198f0 0x7fa45817a2c0 unknown :-1 s=CLOSED pgs=40 gs=2 cs=0 l=1 c_cookie=11631036053802042763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.780+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/4030529549 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa458114190 0x7fa458119140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:10.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.780+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/4030529549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4581137a0 0x7fa458113b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:10.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.780+0000 7fa45e5746c0 1 -- 10.20.193.40:0/4030529549 >> 10.20.193.40:0/4030529549 conn(0x7fa458060760 msgr2=0x7fa458060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:10.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.781+0000 7fa45e5746c0 1 -- 10.20.193.40:0/4030529549 shutdown_connections 2026-02-13T01:22:10.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.781+0000 7fa45e5746c0 1 -- 10.20.193.40:0/4030529549 wait complete. 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.781+0000 7fa45e5746c0 1 Processor -- start 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.781+0000 7fa45e5746c0 1 -- start start 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa45e5746c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4581137a0 0x7fa458121490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa45e5746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4581198f0 0x7fa4581219d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa45e5746c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa458126d40 0x7fa4581271e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa45e5746c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa458127750 con 0x7fa4581137a0 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa45e5746c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa4581278c0 con 0x7fa458126d40 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa45e5746c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa458127a80 con 0x7fa4581198f0 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa457fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4581137a0 0x7fa458121490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa4577fe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4581198f0 0x7fa4581219d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa457fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4581137a0 0x7fa458121490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60646/0 (socket says 10.20.193.40:60646) 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa457fff6c0 1 -- 10.20.193.40:0/1001426775 learned_addr learned my addr 10.20.193.40:0/1001426775 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa45caea6c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa458126d40 0x7fa4581271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa457fff6c0 1 -- 10.20.193.40:0/1001426775 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4581198f0 msgr2=0x7fa4581219d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa457fff6c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4581198f0 0x7fa4581219d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa457fff6c0 1 -- 10.20.193.40:0/1001426775 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa458126d40 msgr2=0x7fa4581271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa457fff6c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa458126d40 0x7fa4581271e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa457fff6c0 1 -- 10.20.193.40:0/1001426775 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4440094c0 con 0x7fa4581137a0 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa457fff6c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4581137a0 0x7fa458121490 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa44400ba30 tx=0x7fa44400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa4557fa6c0 1 -- 10.20.193.40:0/1001426775 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4440044a0 con 0x7fa4581137a0 2026-02-13T01:22:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa4557fa6c0 1 -- 10.20.193.40:0/1001426775 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa444009030 con 0x7fa4581137a0 2026-02-13T01:22:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa4557fa6c0 1 -- 10.20.193.40:0/1001426775 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa444007440 con 0x7fa4581137a0 2026-02-13T01:22:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.782+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44c00a660 con 0x7fa4581137a0 2026-02-13T01:22:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.783+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa458168280 con 0x7fa4581137a0 2026-02-13T01:22:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.783+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4581149e0 con 0x7fa4581137a0 2026-02-13T01:22:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.785+0000 7fa4557fa6c0 1 -- 10.20.193.40:0/1001426775 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7fa44400c690 con 0x7fa4581137a0 2026-02-13T01:22:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.787+0000 7fa4557fa6c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa42c0b5640 0x7fa42c0d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.787+0000 7fa4557fa6c0 1 -- 10.20.193.40:0/1001426775 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2436+0+0 (secure 0 0 0) 0x7fa4440e24b0 con 0x7fa4581137a0 2026-02-13T01:22:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.787+0000 7fa4557fa6c0 1 -- 10.20.193.40:0/1001426775 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa4440e28e0 con 0x7fa4581137a0 2026-02-13T01:22:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.787+0000 7fa4577fe6c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa42c0b5640 0x7fa42c0d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.787+0000 7fa4577fe6c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa42c0b5640 0x7fa42c0d5af0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa458127dd0 tx=0x7fa448009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:10.895+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fa4581225f0 con 0x7fa42c0b5640 2026-02-13T01:22:11.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='osd.2 [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:11.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:10 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:11.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T01:22:11.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='osd.2 [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:11.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T01:22:11.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:11.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:10 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:11.253 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:10 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2[33963]: 2026-02-13T01:22:10.963+0000 7f29c67686c0 -1 osd.2 0 waiting for initial osdmap 2026-02-13T01:22:11.254 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:10 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2[33963]: 2026-02-13T01:22:10.967+0000 7f29be6246c0 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='osd.2 [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:11.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:10 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:12.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: osdmap e15: 3 total, 2 up, 3 in 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:11 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:12.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:12.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:22:12.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: osdmap e15: 3 total, 2 up, 3 in 2026-02-13T01:22:12.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:12.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:11 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:22:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: osdmap e15: 3 total, 2 up, 3 in 2026-02-13T01:22:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:11 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:13.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:22:13.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:22:13.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:13.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: osd.2 [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] boot 2026-02-13T01:22:13.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: osdmap e16: 3 total, 3 up, 3 in 2026-02-13T01:22:13.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:13.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:22:13.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/352431016' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d7a9da01-a235-4069-9e09-562abc3c2ba4"} : dispatch 2026-02-13T01:22:13.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T01:22:13.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/352431016' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7a9da01-a235-4069-9e09-562abc3c2ba4"}]': finished 2026-02-13T01:22:13.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T01:22:13.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:13.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:22:13.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:12 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/893102458' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:13.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:22:13.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:22:13.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:13.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: osd.2 [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] boot 2026-02-13T01:22:13.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: osdmap e16: 3 total, 3 up, 3 in 2026-02-13T01:22:13.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:13.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:22:13.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/352431016' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d7a9da01-a235-4069-9e09-562abc3c2ba4"} : dispatch 2026-02-13T01:22:13.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T01:22:13.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/352431016' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7a9da01-a235-4069-9e09-562abc3c2ba4"}]': finished 2026-02-13T01:22:13.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T01:22:13.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:13.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:22:13.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:12 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/893102458' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: osd.2 [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] boot 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: osdmap e16: 3 total, 3 up, 3 in 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/352431016' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d7a9da01-a235-4069-9e09-562abc3c2ba4"} : dispatch 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/352431016' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7a9da01-a235-4069-9e09-562abc3c2ba4"}]': finished 2026-02-13T01:22:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T01:22:13.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:13.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:22:13.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:12 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/893102458' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:13.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36556]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T01:22:13.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36556]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36556]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36560]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T01:22:13.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36560]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36560]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36564]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T01:22:13.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36564]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36564]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36568]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T01:22:13.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36568]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:13 trial055 sudo[36568]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39717]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T01:22:13.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39717]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39717]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39865]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T01:22:13.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39865]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39865]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39458]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T01:22:13.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39458]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39458]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39482]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T01:22:13.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39482]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:22:13 trial040 sudo[39482]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37199]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T01:22:13.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37199]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37199]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37203]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T01:22:13.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37203]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37203]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.754 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37191]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T01:22:13.754 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37191]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.754 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.754 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37191]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:13.754 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37195]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T01:22:13.754 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37195]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:22:13.754 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:22:13.754 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:22:13 trial118 sudo[37195]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: pgmap v34: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:22:14.520 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:22:14.521 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:22:14.521 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:14.625+0000 7fa4557fa6c0 1 -- 10.20.193.40:0/1001426775 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fa4440b4050 con 0x7fa4581137a0 2026-02-13T01:22:14.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: pgmap v34: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:22:14.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: pgmap v34: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:14.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:22:14.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:22:14.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:15.572 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:15 trial040 ceph-mon[23046]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T01:22:15.572 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:15 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:15.572 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:15 trial040 ceph-mon[23046]: mgrmap e15: x(active, since 38s), standbys: z, y 2026-02-13T01:22:15.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:15 trial055 ceph-mon[27509]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T01:22:15.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:15 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:15.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:15 trial055 ceph-mon[27509]: mgrmap e15: x(active, since 38s), standbys: z, y 2026-02-13T01:22:15.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:15 trial118 ceph-mon[27812]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T01:22:15.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:15 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:15.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:15 trial118 ceph-mon[27812]: mgrmap e15: x(active, since 38s), standbys: z, y 2026-02-13T01:22:16.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:16 trial040 ceph-mon[23046]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:16.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:16 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:16.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T01:22:16.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:16.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:16 trial055 ceph-mon[27509]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:16.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:16 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:16.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T01:22:16.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:16.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:16 trial118 ceph-mon[27812]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:16.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:16 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:16.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T01:22:16.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:18.544 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:18 trial040 ceph-mon[23046]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:18.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:18 trial055 ceph-mon[27509]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:18.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:18 trial118 ceph-mon[27812]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:19.486 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:19.486 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:19.486 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:19.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:19.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:19.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:19.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:19.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:19.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.465 INFO:teuthology.orchestra.run.trial040.stdout:Created osd(s) 3 on host 'trial040' 2026-02-13T01:22:20.466 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.464+0000 7fa4557fa6c0 1 -- 10.20.193.40:0/1001426775 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fa4581225f0 con 0x7fa42c0b5640 2026-02-13T01:22:20.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa42c0b5640 msgr2=0x7fa42c0d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:20.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa42c0b5640 0x7fa42c0d5af0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa458127dd0 tx=0x7fa448009260 comp rx=0 tx=0).stop 2026-02-13T01:22:20.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4581137a0 msgr2=0x7fa458121490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:20.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4581137a0 0x7fa458121490 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa44400ba30 tx=0x7fa44400bf00 comp rx=0 tx=0).stop 2026-02-13T01:22:20.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 shutdown_connections 2026-02-13T01:22:20.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa42c0b5640 0x7fa42c0d5af0 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:20.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa458126d40 0x7fa4581271e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:20.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4581198f0 0x7fa4581219d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:20.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 --2- 10.20.193.40:0/1001426775 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4581137a0 0x7fa458121490 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:20.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 >> 10.20.193.40:0/1001426775 conn(0x7fa458060760 msgr2=0x7fa4581166f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:20.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.466+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 shutdown_connections 2026-02-13T01:22:20.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:20.467+0000 7fa45e5746c0 1 -- 10.20.193.40:0/1001426775 wait complete. 2026-02-13T01:22:20.528 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:20.528 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T01:22:20.528 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.528 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.528 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:20.528 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:20.528 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.528 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:20.529 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:20.529 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:20.573 DEBUG:teuthology.orchestra.run.trial040:osd.3> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.3.service 2026-02-13T01:22:20.577 INFO:tasks.cephadm:Deploying osd.4 on trial055 with /dev/vg_nvme/lv_3... 2026-02-13T01:22:20.577 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T01:22:20.603 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:20.603 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T01:22:20.603 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.603 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.603 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:20.603 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:20.603 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.604 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:20.604 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:20.604 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:20.699 INFO:teuthology.orchestra.run.trial055.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.b/config 2026-02-13T01:22:20.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:20.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T01:22:20.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:20.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:20.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:20.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:20.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:20.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:21.155 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:22:21.172 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial055:vg_nvme/lv_3 --skip-validation 2026-02-13T01:22:21.330 INFO:teuthology.orchestra.run.trial055.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.b/config 2026-02-13T01:22:21.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:21.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T01:22:21.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T01:22:21.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:22:21.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:21.378 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:21.379 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:21.379 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:21.379 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:21.379 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:21.379 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:22:21 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3[41498]: 2026-02-13T01:22:21.277+0000 7f38c27ea6c0 -1 osd.3 0 waiting for initial osdmap 2026-02-13T01:22:21.379 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:22:21 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3[41498]: 2026-02-13T01:22:21.281+0000 7f38ba6a66c0 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:21.446 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:21.449 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.444+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3449821881 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f283410fc20 msgr2=0x7f2834114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.444+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3449821881 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f283410fc20 0x7f2834114c60 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=2153577630303847747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f281c009970 tx=0x7f281c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.444+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3449821881 shutdown_connections 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.444+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3449821881 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2834115440 0x7f2834175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.444+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3449821881 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f283410fc20 0x7f2834114c60 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=2153577630303847747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.444+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3449821881 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f283410f230 0x7f283410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.444+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3449821881 >> 10.20.193.55:0/3449821881 conn(0x7f28340ecb30 msgr2=0x7f283410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.444+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3449821881 shutdown_connections 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.444+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3449821881 wait complete. 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 Processor -- start 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 -- start start 2026-02-13T01:22:21.450 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f283410f230 0x7f283411d000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2834115440 0x7f283411d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2834122900 0x7f2834122da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2834123310 con 0x7f2834115440 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2834123480 con 0x7f2834122900 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2834123640 con 0x7f283410f230 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2838f456c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2834122900 0x7f2834122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2838f456c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2834122900 0x7f2834122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.55:41164/0 (socket says 10.20.193.55:41164) 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2838f456c0 1 -- 10.20.193.55:0/3477298560 learned_addr learned my addr 10.20.193.55:0/3477298560 (peer_addr_for_me v2:10.20.193.55:0/0) 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2833fff6c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f283410f230 0x7f283411d000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2838f456c0 1 -- 10.20.193.55:0/3477298560 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f283410f230 msgr2=0x7f283411d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:21.451 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2838f456c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f283410f230 0x7f283411d000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2838f456c0 1 -- 10.20.193.55:0/3477298560 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2834115440 msgr2=0x7f283411d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2838f456c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2834115440 0x7f283411d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2838f456c0 1 -- 10.20.193.55:0/3477298560 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281c009590 con 0x7f2834122900 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f2838f456c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2834122900 0x7f2834122da0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f282800c6c0 tx=0x7f282800cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f28317fa6c0 1 -- 10.20.193.55:0/3477298560 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2828003c40 con 0x7f2834122900 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f28317fa6c0 1 -- 10.20.193.55:0/3477298560 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f282800a030 con 0x7f2834122900 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2834163af0 con 0x7f2834122900 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f28317fa6c0 1 -- 10.20.193.55:0/3477298560 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f282800ddc0 con 0x7f2834122900 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.445+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2834163f80 con 0x7f2834122900 2026-02-13T01:22:21.452 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.446+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2834110500 con 0x7f2834122900 2026-02-13T01:22:21.453 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.447+0000 7f28317fa6c0 1 -- 10.20.193.55:0/3477298560 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f2828005030 con 0x7f2834122900 2026-02-13T01:22:21.453 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.448+0000 7f28317fa6c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f27fc0b5650 0x7f27fc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:21.454 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.448+0000 7f28317fa6c0 1 -- 10.20.193.55:0/3477298560 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3381+0+0 (secure 0 0 0) 0x7f28280e3790 con 0x7f2834122900 2026-02-13T01:22:21.454 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.448+0000 7f2833fff6c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f27fc0b5650 0x7f27fc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:21.454 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.449+0000 7f28317fa6c0 1 -- 10.20.193.55:0/3477298560 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f28280a7430 con 0x7f2834122900 2026-02-13T01:22:21.454 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.449+0000 7f2833fff6c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f27fc0b5650 0x7f27fc0d5b00 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2820005980 tx=0x7f2820005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:21.549 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:21.546+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f283411e1e0 con 0x7f27fc0b5650 2026-02-13T01:22:21.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:21.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T01:22:21.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T01:22:21.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:22:21.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:21.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:21.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:21.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:21.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:21.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:22.430 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:22.430 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:22:22.430 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T01:22:22.430 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:22.430 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:22.430 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:22.430 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:22.430 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:22.430 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:22.431 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:22.431 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:22.431 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:22.431 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] boot 2026-02-13T01:22:22.431 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:22 trial055 ceph-mon[27509]: osdmap e22: 4 total, 4 up, 4 in 2026-02-13T01:22:22.533 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:22.533 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:22:22.533 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] boot 2026-02-13T01:22:22.534 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:22 trial040 ceph-mon[23046]: osdmap e22: 4 total, 4 up, 4 in 2026-02-13T01:22:22.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:22:22.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: from='osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:22:22.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T01:22:22.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:22.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:22.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:22.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:22.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:22.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:22.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:22.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:22.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:22.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: osd.3 [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] boot 2026-02-13T01:22:22.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:22 trial118 ceph-mon[27812]: osdmap e22: 4 total, 4 up, 4 in 2026-02-13T01:22:23.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:22:23.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:22:23.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:23.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='client.? 10.20.193.55:0/3797097714' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a3a5b0ea-f758-46ce-bd6d-afaa74db16bb"} : dispatch 2026-02-13T01:22:23.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a3a5b0ea-f758-46ce-bd6d-afaa74db16bb"} : dispatch 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3a5b0ea-f758-46ce-bd6d-afaa74db16bb"}]': finished 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='client.? 10.20.193.55:0/2890005684' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:23.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:23.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:23.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:23.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:23.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:22:23.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:22:23.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:23.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='client.? 10.20.193.55:0/3797097714' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a3a5b0ea-f758-46ce-bd6d-afaa74db16bb"} : dispatch 2026-02-13T01:22:23.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a3a5b0ea-f758-46ce-bd6d-afaa74db16bb"} : dispatch 2026-02-13T01:22:23.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3a5b0ea-f758-46ce-bd6d-afaa74db16bb"}]': finished 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='client.? 10.20.193.55:0/2890005684' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:23.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:23.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:23.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='client.? 10.20.193.55:0/3797097714' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a3a5b0ea-f758-46ce-bd6d-afaa74db16bb"} : dispatch 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a3a5b0ea-f758-46ce-bd6d-afaa74db16bb"} : dispatch 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3a5b0ea-f758-46ce-bd6d-afaa74db16bb"}]': finished 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='client.? 10.20.193.55:0/2890005684' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:23.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:24.579 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T01:22:24.579 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:24.580 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:24.581 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:24.581 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:24.581 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:24.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T01:22:24.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:24.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:24.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:24.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T01:22:24.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:24.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:24.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:24.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:24.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:24.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:24.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:24.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:24.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:24.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:24.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:24.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:24.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:24.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:24.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:25.436 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:25 trial055 ceph-mon[27509]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:25.436 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:25 trial055 ceph-mon[27509]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:25.436 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:25 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T01:22:25.436 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:25 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:25.436 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:25 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:25.436 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:25 trial055 ceph-mon[27509]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T01:22:25.436 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:25 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:25 trial040 ceph-mon[23046]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:25 trial040 ceph-mon[23046]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:25 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T01:22:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:25 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:25 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:25.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:25 trial040 ceph-mon[23046]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T01:22:25.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:25 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:25.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:25 trial118 ceph-mon[27812]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:25.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:25 trial118 ceph-mon[27812]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:25.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:25 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T01:22:25.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:25 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:25.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:25 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:25.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:25 trial118 ceph-mon[27812]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T01:22:25.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:25 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:26.615 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:26 trial055 ceph-mon[27509]: pgmap v51: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 225 KiB/s, 0 objects/s recovering 2026-02-13T01:22:26.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:26 trial040 ceph-mon[23046]: pgmap v51: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 225 KiB/s, 0 objects/s recovering 2026-02-13T01:22:26.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:26 trial118 ceph-mon[27812]: pgmap v51: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 225 KiB/s, 0 objects/s recovering 2026-02-13T01:22:27.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:27.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:27.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:27.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:27.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:27.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:27 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:27.653 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.650+0000 7f28317fa6c0 1 -- 10.20.193.55:0/3477298560 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f2820004020 con 0x7f27fc0b5650 2026-02-13T01:22:27.653 INFO:teuthology.orchestra.run.trial055.stdout:Created osd(s) 4 on host 'trial055' 2026-02-13T01:22:27.656 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f27fc0b5650 msgr2=0x7f27fc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:27.656 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f27fc0b5650 0x7f27fc0d5b00 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2820005980 tx=0x7f2820005910 comp rx=0 tx=0).stop 2026-02-13T01:22:27.656 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2834122900 msgr2=0x7f2834122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:27.656 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2834122900 0x7f2834122da0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f282800c6c0 tx=0x7f282800cb90 comp rx=0 tx=0).stop 2026-02-13T01:22:27.657 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 shutdown_connections 2026-02-13T01:22:27.657 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f27fc0b5650 0x7f27fc0d5b00 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:27.657 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2834122900 0x7f2834122da0 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:27.657 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2834115440 0x7f283411d540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:27.657 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 --2- 10.20.193.55:0/3477298560 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f283410f230 0x7f283411d000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:27.657 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 >> 10.20.193.55:0/3477298560 conn(0x7f28340ecb30 msgr2=0x7f283410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:27.657 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 shutdown_connections 2026-02-13T01:22:27.657 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:27.653+0000 7f283a9d36c0 1 -- 10.20.193.55:0/3477298560 wait complete. 2026-02-13T01:22:27.699 DEBUG:teuthology.orchestra.run.trial055:osd.4> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.4.service 2026-02-13T01:22:27.701 INFO:tasks.cephadm:Deploying osd.5 on trial118 with /dev/vg_nvme/lv_3... 2026-02-13T01:22:27.702 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T01:22:27.727 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:27.728 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:27 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:27.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:27.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:27.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:27.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:27.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:27.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:27.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:27 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:27.823 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:22:28.277 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:22:28.295 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial118:vg_nvme/lv_3 --skip-validation 2026-02-13T01:22:28.453 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:22:28.495 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:28 trial118 ceph-mon[27812]: pgmap v53: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T01:22:28.495 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:28 trial118 ceph-mon[27812]: pgmap v54: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 188 KiB/s, 0 objects/s recovering 2026-02-13T01:22:28.495 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:28 trial118 ceph-mon[27812]: from='osd.4 [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:22:28.495 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:28 trial118 ceph-mon[27812]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:22:28.496 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:28.496 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:28.496 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:28 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:28.496 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:28 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:28.496 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:28.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3584829387 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f179810d9a0 msgr2=0x7f17981129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:28.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3584829387 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f179810d9a0 0x7f17981129e0 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=13224156213359524686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17800099a0 tx=0x7f178002ed20 comp rx=0 tx=0).stop 2026-02-13T01:22:28.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3584829387 shutdown_connections 2026-02-13T01:22:28.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3584829387 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f17981131c0 0x7f1798173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:28.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3584829387 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f179810d9a0 0x7f17981129e0 unknown :-1 s=CLOSED pgs=44 gs=1 cs=0 l=1 c_cookie=13224156213359524686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:28.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3584829387 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f179810cfb0 0x7f179810d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:28.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3584829387 >> 10.20.193.118:0/3584829387 conn(0x7f17980ea8b0 msgr2=0x7f179810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:28.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3584829387 shutdown_connections 2026-02-13T01:22:28.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3584829387 wait complete. 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 Processor -- start 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.568+0000 7f179dfc76c0 1 -- start start 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f179dfc76c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f179810cfb0 0x7f17980f26e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f179dfc76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17981131c0 0x7f1798173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f179dfc76c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17980f2d10 0x7f17980f7fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f179dfc76c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17980f3400 con 0x7f17981131c0 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f179dfc76c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f17980f8520 con 0x7f179810cfb0 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f179dfc76c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f17980f86e0 con 0x7f17980f2d10 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1797fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17980f2d10 0x7f17980f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1797fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17980f2d10 0x7f17980f7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.118:40038/0 (socket says 10.20.193.118:40038) 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1797fff6c0 1 -- 10.20.193.118:0/3006227888 learned_addr learned my addr 10.20.193.118:0/3006227888 (peer_addr_for_me v2:10.20.193.118:0/0) 2026-02-13T01:22:28.574 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f17977fe6c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f179810cfb0 0x7f17980f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1796ffd6c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17981131c0 0x7f1798173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1797fff6c0 1 -- 10.20.193.118:0/3006227888 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f179810cfb0 msgr2=0x7f17980f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1797fff6c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f179810cfb0 0x7f17980f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1797fff6c0 1 -- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17981131c0 msgr2=0x7f1798173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1797fff6c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17981131c0 0x7f1798173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1797fff6c0 1 -- 10.20.193.118:0/3006227888 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1780009590 con 0x7f17980f2d10 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1797fff6c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17980f2d10 0x7f17980f7fe0 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f178c00c6f0 tx=0x7f178c00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1794ff96c0 1 -- 10.20.193.118:0/3006227888 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f178c003a30 con 0x7f17980f2d10 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1794ff96c0 1 -- 10.20.193.118:0/3006227888 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f178c005550 con 0x7f17980f2d10 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17980f89c0 con 0x7f17980f2d10 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f1794ff96c0 1 -- 10.20.193.118:0/3006227888 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f178c010070 con 0x7f17980f2d10 2026-02-13T01:22:28.575 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.569+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17980f9150 con 0x7f17980f2d10 2026-02-13T01:22:28.576 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.570+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179810e280 con 0x7f17980f2d10 2026-02-13T01:22:28.577 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.571+0000 7f1794ff96c0 1 -- 10.20.193.118:0/3006227888 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f178c005080 con 0x7f17980f2d10 2026-02-13T01:22:28.577 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.572+0000 7f1794ff96c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17600b56d0 0x7f17600d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:28.577 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.572+0000 7f1794ff96c0 1 -- 10.20.193.118:0/3006227888 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3797+0+0 (secure 0 0 0) 0x7f178c0e38a0 con 0x7f17980f2d10 2026-02-13T01:22:28.577 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.572+0000 7f17977fe6c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17600b56d0 0x7f17600d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:28.577 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.572+0000 7f1794ff96c0 1 -- 10.20.193.118:0/3006227888 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f178c0a73a0 con 0x7f17980f2d10 2026-02-13T01:22:28.577 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.573+0000 7f17977fe6c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17600b56d0 0x7f17600d5b80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1784006b60 tx=0x7f1784006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:28.583 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:28 trial055 ceph-mon[27509]: pgmap v53: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T01:22:28.583 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:28 trial055 ceph-mon[27509]: pgmap v54: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 188 KiB/s, 0 objects/s recovering 2026-02-13T01:22:28.584 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:28 trial055 ceph-mon[27509]: from='osd.4 [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:22:28.584 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:28 trial055 ceph-mon[27509]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:22:28.584 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:28.584 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:28.584 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:28 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:28.584 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:28 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:28.584 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:28.674 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:28.671+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f17980f3830 con 0x7f17600b56d0 2026-02-13T01:22:28.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:28 trial040 ceph-mon[23046]: pgmap v53: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T01:22:28.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:28 trial040 ceph-mon[23046]: pgmap v54: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 188 KiB/s, 0 objects/s recovering 2026-02-13T01:22:28.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:28 trial040 ceph-mon[23046]: from='osd.4 [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:22:28.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:28 trial040 ceph-mon[23046]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:22:28.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:28.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:28.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:28 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:28.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:28 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:28.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:29.587 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: pgmap v55: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 156 KiB/s, 0 objects/s recovering 2026-02-13T01:22:29.587 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T01:22:29.587 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='osd.4 [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:29.587 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T01:22:29.587 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:29.587 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:29.587 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:29.588 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:29.589 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.589 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: pgmap v57: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:29.589 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:29.589 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:29.589 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:29.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: pgmap v55: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 156 KiB/s, 0 objects/s recovering 2026-02-13T01:22:29.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T01:22:29.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='osd.4 [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: pgmap v57: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:29.744 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:29.745 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:22:29 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4[39626]: 2026-02-13T01:22:29.356+0000 7fc6cd85b6c0 -1 osd.4 0 waiting for initial osdmap 2026-02-13T01:22:29.745 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:22:29 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4[39626]: 2026-02-13T01:22:29.360+0000 7fc6c971f6c0 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:22:29.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: pgmap v55: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 156 KiB/s, 0 objects/s recovering 2026-02-13T01:22:29.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T01:22:29.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='osd.4 [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:29.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T01:22:29.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:29.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:29.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:29.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:29.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:29.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: pgmap v57: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:22:29.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:29.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:29.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:30.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:22:30.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T01:22:30.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:30.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:30.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: from='client.? 10.20.193.118:0/162052350' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "785971ea-187d-4818-a068-2f11a062f7f3"} : dispatch 2026-02-13T01:22:30.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "785971ea-187d-4818-a068-2f11a062f7f3"} : dispatch 2026-02-13T01:22:30.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "785971ea-187d-4818-a068-2f11a062f7f3"}]': finished 2026-02-13T01:22:30.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: osd.4 [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] boot 2026-02-13T01:22:30.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T01:22:30.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:30.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:30.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: from='client.? 10.20.193.118:0/3735850336' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:30.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:30.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:30 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/162052350' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "785971ea-187d-4818-a068-2f11a062f7f3"} : dispatch 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "785971ea-187d-4818-a068-2f11a062f7f3"} : dispatch 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "785971ea-187d-4818-a068-2f11a062f7f3"}]': finished 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: osd.4 [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] boot 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T01:22:30.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:30.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:30.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/3735850336' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:30.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:30.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:30 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: from='client.? 10.20.193.118:0/162052350' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "785971ea-187d-4818-a068-2f11a062f7f3"} : dispatch 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "785971ea-187d-4818-a068-2f11a062f7f3"} : dispatch 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "785971ea-187d-4818-a068-2f11a062f7f3"}]': finished 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: osd.4 [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] boot 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:22:30.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:30.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: from='client.? 10.20.193.118:0/3735850336' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:30.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:30.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:30 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:31.740 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:31.741 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:31.742 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:31.742 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:31.742 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:22:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:22:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T01:22:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:31.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:31.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:31.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:32.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:32.595 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:32 trial118 ceph-mon[27812]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:32.595 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:32 trial118 ceph-mon[27812]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:32.596 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:32 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T01:22:32.596 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:32 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:32 trial055 ceph-mon[27509]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:32 trial055 ceph-mon[27509]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:32 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T01:22:32.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:32 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:32.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:32 trial040 ceph-mon[23046]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:32.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:32 trial040 ceph-mon[23046]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:32.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:32 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T01:22:32.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:32 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:33.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:33 trial118 ceph-mon[27812]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:33.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:33 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:33.900 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:33 trial040 ceph-mon[23046]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:33.900 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:33 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:33.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:33 trial055 ceph-mon[27509]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:33.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:33 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:34.744 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:34.744 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.744 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.744 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.744 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.744 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:34.745 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:34.745 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.745 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:34.745 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:34.745 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:34.850 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.849+0000 7f1794ff96c0 1 -- 10.20.193.118:0/3006227888 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f17980f3830 con 0x7f17600b56d0 2026-02-13T01:22:34.851 INFO:teuthology.orchestra.run.trial118.stdout:Created osd(s) 5 on host 'trial118' 2026-02-13T01:22:34.853 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17600b56d0 msgr2=0x7f17600d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:34.853 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17600b56d0 0x7f17600d5b80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1784006b60 tx=0x7f1784006af0 comp rx=0 tx=0).stop 2026-02-13T01:22:34.853 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17980f2d10 msgr2=0x7f17980f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:34.854 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17980f2d10 0x7f17980f7fe0 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f178c00c6f0 tx=0x7f178c00cbc0 comp rx=0 tx=0).stop 2026-02-13T01:22:34.854 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 shutdown_connections 2026-02-13T01:22:34.854 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17600b56d0 0x7f17600d5b80 unknown :-1 s=CLOSED pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:34.854 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17980f2d10 0x7f17980f7fe0 unknown :-1 s=CLOSED pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:34.854 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17981131c0 0x7f1798173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:34.854 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 --2- 10.20.193.118:0/3006227888 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f179810cfb0 0x7f17980f26e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:34.854 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 >> 10.20.193.118:0/3006227888 conn(0x7f17980ea8b0 msgr2=0x7f179810b470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:34.854 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 shutdown_connections 2026-02-13T01:22:34.854 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:34.851+0000 7f179dfc76c0 1 -- 10.20.193.118:0/3006227888 wait complete. 2026-02-13T01:22:34.894 DEBUG:teuthology.orchestra.run.trial118:osd.5> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.5.service 2026-02-13T01:22:34.897 INFO:tasks.cephadm:Deploying osd.6 on trial040 with /dev/vg_nvme/lv_2... 2026-02-13T01:22:34.897 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T01:22:34.949 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:34.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:34.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:34.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:34.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:34.951 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:34.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:34.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:34.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:35.086 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:22:35.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:35 trial040 ceph-mon[23046]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:35.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:35 trial040 ceph-mon[23046]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:35.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:35 trial040 ceph-mon[23046]: from='osd.5 [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:22:35.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:35 trial040 ceph-mon[23046]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:22:35.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:35 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:35.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:35 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:35.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:35.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:35.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:35 trial118 ceph-mon[27812]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:35 trial118 ceph-mon[27812]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:35 trial118 ceph-mon[27812]: from='osd.5 [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:22:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:35 trial118 ceph-mon[27812]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:22:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:35 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:35 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:35.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:35.977 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:22:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:35 trial055 ceph-mon[27509]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:35 trial055 ceph-mon[27509]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:35 trial055 ceph-mon[27509]: from='osd.5 [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:22:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:35 trial055 ceph-mon[27509]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:22:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:35 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:35 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:35.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:36.003 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial040:vg_nvme/lv_2 --skip-validation 2026-02-13T01:22:36.191 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:22:36.379 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 -- 10.20.193.40:0/3797983210 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd1810fbf0 msgr2=0x7fbd18114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:36.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 --2- 10.20.193.40:0/3797983210 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd1810fbf0 0x7fbd18114c30 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=15608317560142506989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd0c0099a0 tx=0x7fbd0c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:22:36.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 -- 10.20.193.40:0/3797983210 shutdown_connections 2026-02-13T01:22:36.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 --2- 10.20.193.40:0/3797983210 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbd18115410 0x7fbd18175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:36.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 --2- 10.20.193.40:0/3797983210 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd1810fbf0 0x7fbd18114c30 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=15608317560142506989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:36.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 --2- 10.20.193.40:0/3797983210 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbd1810f200 0x7fbd1810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:36.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 -- 10.20.193.40:0/3797983210 >> 10.20.193.40:0/3797983210 conn(0x7fbd180ecb00 msgr2=0x7fbd1810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:36.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 -- 10.20.193.40:0/3797983210 shutdown_connections 2026-02-13T01:22:36.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 -- 10.20.193.40:0/3797983210 wait complete. 2026-02-13T01:22:36.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.378+0000 7fbd200396c0 1 Processor -- start 2026-02-13T01:22:36.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd200396c0 1 -- start start 2026-02-13T01:22:36.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd200396c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbd1810f200 0x7fbd180f4a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:36.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd200396c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd18115410 0x7fbd18175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd200396c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbd180f5040 0x7fbd180fa310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd200396c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbd180f5730 con 0x7fbd18115410 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd200396c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbd180fa850 con 0x7fbd1810f200 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd200396c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbd180faa10 con 0x7fbd180f5040 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd1d5a96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd18115410 0x7fbd18175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd1d5a96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd18115410 0x7fbd18175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:40834/0 (socket says 10.20.193.40:40834) 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd1d5a96c0 1 -- 10.20.193.40:0/130900419 learned_addr learned my addr 10.20.193.40:0/130900419 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd1e5ab6c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbd180f5040 0x7fbd180fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.379+0000 7fbd1ddaa6c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbd1810f200 0x7fbd180f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd1d5a96c0 1 -- 10.20.193.40:0/130900419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbd180f5040 msgr2=0x7fbd180fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:36.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd1d5a96c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbd180f5040 0x7fbd180fa310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd1d5a96c0 1 -- 10.20.193.40:0/130900419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbd1810f200 msgr2=0x7fbd180f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd1d5a96c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbd1810f200 0x7fbd180f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd1d5a96c0 1 -- 10.20.193.40:0/130900419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c009590 con 0x7fbd18115410 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd1e5ab6c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbd180f5040 0x7fbd180fa310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd1d5a96c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd18115410 0x7fbd18175cb0 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd0c0092e0 tx=0x7fbd0c02f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd06ffd6c0 1 -- 10.20.193.40:0/130900419 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd0c0046b0 con 0x7fbd18115410 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd06ffd6c0 1 -- 10.20.193.40:0/130900419 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbd0c005e70 con 0x7fbd18115410 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd06ffd6c0 1 -- 10.20.193.40:0/130900419 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd0c0073f0 con 0x7fbd18115410 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd180fac90 con 0x7fbd18115410 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd180fb160 con 0x7fbd18115410 2026-02-13T01:22:36.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.380+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd181104d0 con 0x7fbd18115410 2026-02-13T01:22:36.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.383+0000 7fbd06ffd6c0 1 -- 10.20.193.40:0/130900419 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fbd0c0026b0 con 0x7fbd18115410 2026-02-13T01:22:36.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.384+0000 7fbd06ffd6c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcf40b56d0 0x7fbcf40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:36.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.384+0000 7fbd06ffd6c0 1 -- 10.20.193.40:0/130900419 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4229+0+0 (secure 0 0 0) 0x7fbd0c106d00 con 0x7fbd18115410 2026-02-13T01:22:36.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.384+0000 7fbd1ddaa6c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcf40b56d0 0x7fbcf40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:36.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.384+0000 7fbd06ffd6c0 1 -- 10.20.193.40:0/130900419 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbd0c0ca650 con 0x7fbd18115410 2026-02-13T01:22:36.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.385+0000 7fbd1ddaa6c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcf40b56d0 0x7fbcf40d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd08004750 tx=0x7fbd08009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:36.493 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:36.491+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fbd180f5b90 con 0x7fbcf40b56d0 2026-02-13T01:22:36.589 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:22:36 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:22:36.513+0000 7f7523db46c0 -1 osd.5 0 waiting for initial osdmap 2026-02-13T01:22:36.589 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:22:36 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:22:36.517+0000 7f751fc786c0 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:22:36.589 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='osd.5 [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:36.590 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:36.591 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:36.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:36.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T01:22:36.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='osd.5 [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:36.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T01:22:36.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:36.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:36.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:36.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:36.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:36.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:36.751 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:36.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:36.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T01:22:36.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='osd.5 [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:36.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T01:22:36.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:36.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:22:36.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:36.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:36.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:36.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:36.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:37.979 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:37.979 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:37.979 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:22:37.979 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T01:22:37.979 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:37.979 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:37.979 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:37.979 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:37.980 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:37 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:37.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:37.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:37.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:22:37.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T01:22:37.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:37.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:37.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:37.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:37.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:37.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:37 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:38.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:38.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:38.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:22:38.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T01:22:38.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:38.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:38.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:38.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:38.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:38.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:37 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:38.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:22:38.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:22:38.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:38.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: osd.5 [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] boot 2026-02-13T01:22:38.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T01:22:38.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:38.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2749197890' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d852201c-70dd-4be3-af89-2a49bdf1e9eb"} : dispatch 2026-02-13T01:22:38.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2749197890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d852201c-70dd-4be3-af89-2a49bdf1e9eb"}]': finished 2026-02-13T01:22:38.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T01:22:38.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:38.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:38 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/23559976' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:22:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:22:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: osd.5 [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] boot 2026-02-13T01:22:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T01:22:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2749197890' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d852201c-70dd-4be3-af89-2a49bdf1e9eb"} : dispatch 2026-02-13T01:22:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2749197890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d852201c-70dd-4be3-af89-2a49bdf1e9eb"}]': finished 2026-02-13T01:22:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T01:22:39.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:39.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:38 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/23559976' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:39.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: osd.5 [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] boot 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2749197890' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d852201c-70dd-4be3-af89-2a49bdf1e9eb"} : dispatch 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2749197890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d852201c-70dd-4be3-af89-2a49bdf1e9eb"}]': finished 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:39.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:38 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/23559976' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:39.832 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:39 trial040 ceph-mon[23046]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:22:39.833 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:39 trial040 ceph-mon[23046]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T01:22:39.833 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:39.833 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:39 trial040 ceph-mon[23046]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T01:22:39.833 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:39.893 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:39 trial055 ceph-mon[27509]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:22:39.893 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:39 trial055 ceph-mon[27509]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T01:22:39.893 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:39.893 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:39 trial055 ceph-mon[27509]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T01:22:39.893 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:40.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:39 trial118 ceph-mon[27812]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:22:40.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:39 trial118 ceph-mon[27812]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T01:22:40.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:40.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:39 trial118 ceph-mon[27812]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T01:22:40.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:41 trial055 ceph-mon[27509]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T01:22:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:41 trial055 ceph-mon[27509]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 187 KiB/s, 0 objects/s recovering 2026-02-13T01:22:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T01:22:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:41.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:41 trial040 ceph-mon[23046]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T01:22:41.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:41.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:41 trial040 ceph-mon[23046]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 187 KiB/s, 0 objects/s recovering 2026-02-13T01:22:41.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T01:22:41.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:41.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:41 trial118 ceph-mon[27812]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T01:22:41.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:41.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:41 trial118 ceph-mon[27812]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 187 KiB/s, 0 objects/s recovering 2026-02-13T01:22:41.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T01:22:41.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:42.206 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:42 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:42.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:42 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:42.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:42 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:43.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:43 trial040 ceph-mon[23046]: pgmap v80: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T01:22:43.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:43 trial055 ceph-mon[27509]: pgmap v80: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T01:22:43.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:43 trial118 ceph-mon[27812]: pgmap v80: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T01:22:45.824 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:45 trial040 ceph-mon[23046]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-13T01:22:45.824 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:45 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:45.824 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:45 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:45.824 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:45 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:45.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:45 trial055 ceph-mon[27509]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-13T01:22:45.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:45 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:45.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:45 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:45.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:45 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:45 trial118 ceph-mon[27812]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-13T01:22:46.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:45 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:46.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:45 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:45 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.380+0000 7fbd06ffd6c0 1 -- 10.20.193.40:0/130900419 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fbd180f5b90 con 0x7fbcf40b56d0 2026-02-13T01:22:46.383 INFO:teuthology.orchestra.run.trial040.stdout:Created osd(s) 6 on host 'trial040' 2026-02-13T01:22:46.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.381+0000 7fbd1f8346c0 1 -- 10.20.193.40:0/130900419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=32}) -- 0x7fbcf0003570 con 0x7fbd18115410 2026-02-13T01:22:46.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.381+0000 7fbd06ffd6c0 1 -- 10.20.193.40:0/130900419 <== mon.0 v2:10.20.193.40:3300/0 7 ==== osd_map(32..37 src has 1..37) ==== 3128+0+0 (secure 0 0 0) 0x7fbd0c0cea00 con 0x7fbd18115410 2026-02-13T01:22:46.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcf40b56d0 msgr2=0x7fbcf40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:46.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcf40b56d0 0x7fbcf40d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd08004750 tx=0x7fbd08009260 comp rx=0 tx=0).stop 2026-02-13T01:22:46.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd18115410 msgr2=0x7fbd18175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:46.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd18115410 0x7fbd18175cb0 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd0c0092e0 tx=0x7fbd0c02f810 comp rx=0 tx=0).stop 2026-02-13T01:22:46.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 shutdown_connections 2026-02-13T01:22:46.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbcf40b56d0 0x7fbcf40d5b80 unknown :-1 s=CLOSED pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:46.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbd180f5040 0x7fbd180fa310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:46.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbd18115410 0x7fbd18175cb0 unknown :-1 s=CLOSED pgs=133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:46.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 --2- 10.20.193.40:0/130900419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbd1810f200 0x7fbd180f4a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:46.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.382+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 >> 10.20.193.40:0/130900419 conn(0x7fbd180ecb00 msgr2=0x7fbd18113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:46.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.383+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 shutdown_connections 2026-02-13T01:22:46.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:22:46.383+0000 7fbd200396c0 1 -- 10.20.193.40:0/130900419 wait complete. 2026-02-13T01:22:46.525 DEBUG:teuthology.orchestra.run.trial040:osd.6> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.6.service 2026-02-13T01:22:46.529 INFO:tasks.cephadm:Deploying osd.7 on trial055 with /dev/vg_nvme/lv_2... 2026-02-13T01:22:46.529 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T01:22:46.649 INFO:teuthology.orchestra.run.trial055.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.b/config 2026-02-13T01:22:46.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:46 trial040 ceph-mon[23046]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:22:46.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.805 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:46 trial055 ceph-mon[27509]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:22:46.805 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.805 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.805 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:46.805 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:47.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:46 trial118 ceph-mon[27812]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:22:47.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:47.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:47.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:47.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:47.101 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:22:47.118 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial055:vg_nvme/lv_2 --skip-validation 2026-02-13T01:22:47.237 INFO:teuthology.orchestra.run.trial055.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.b/config 2026-02-13T01:22:47.355 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 -- 10.20.193.55:0/2269829972 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 msgr2=0x7f1274175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:47.355 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 --2- 10.20.193.55:0/2269829972 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 0x7f1274175db0 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=17529331927377031214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f126400aa40 tx=0x7f126402fde0 comp rx=0 tx=0).stop 2026-02-13T01:22:47.355 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 -- 10.20.193.55:0/2269829972 shutdown_connections 2026-02-13T01:22:47.355 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 --2- 10.20.193.55:0/2269829972 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 0x7f1274175db0 unknown :-1 s=CLOSED pgs=48 gs=1 cs=0 l=1 c_cookie=17529331927377031214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:47.355 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 --2- 10.20.193.55:0/2269829972 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f127410fbf0 0x7f1274114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:47.355 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 --2- 10.20.193.55:0/2269829972 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f127410f200 0x7f127410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:47.355 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 -- 10.20.193.55:0/2269829972 >> 10.20.193.55:0/2269829972 conn(0x7f12740ecb00 msgr2=0x7f127410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 -- 10.20.193.55:0/2269829972 shutdown_connections 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 -- 10.20.193.55:0/2269829972 wait complete. 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 Processor -- start 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.350+0000 7f1278be76c0 1 -- start start 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1278be76c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f127410f200 0x7f127411cf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1278be76c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 0x7f127411d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1278be76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1274122800 0x7f1274122ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1278be76c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1274123210 con 0x7f1274122800 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1278be76c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1274123380 con 0x7f1274115410 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1278be76c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1274123540 con 0x7f127410f200 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1271d746c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 0x7f127411d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:47.356 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1271d746c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 0x7f127411d440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.55:59048/0 (socket says 10.20.193.55:59048) 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1271d746c0 1 -- 10.20.193.55:0/1540479798 learned_addr learned my addr 10.20.193.55:0/1540479798 (peer_addr_for_me v2:10.20.193.55:0/0) 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f12725756c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f127410f200 0x7f127411cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1272d766c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1274122800 0x7f1274122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1271d746c0 1 -- 10.20.193.55:0/1540479798 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f127410f200 msgr2=0x7f127411cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1271d746c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f127410f200 0x7f127411cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1271d746c0 1 -- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1274122800 msgr2=0x7f1274122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1271d746c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1274122800 0x7f1274122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1271d746c0 1 -- 10.20.193.55:0/1540479798 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126400a660 con 0x7f1274115410 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1272d766c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1274122800 0x7f1274122ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1271d746c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 0x7f127411d440 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1258005dc0 tx=0x7f125800bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:47.357 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f126b7fe6c0 1 -- 10.20.193.55:0/1540479798 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1258004250 con 0x7f1274115410 2026-02-13T01:22:47.358 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f126b7fe6c0 1 -- 10.20.193.55:0/1540479798 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1258009070 con 0x7f1274115410 2026-02-13T01:22:47.358 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12741639f0 con 0x7f1274115410 2026-02-13T01:22:47.358 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f126b7fe6c0 1 -- 10.20.193.55:0/1540479798 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12580071c0 con 0x7f1274115410 2026-02-13T01:22:47.358 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1274163e80 con 0x7f1274115410 2026-02-13T01:22:47.358 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.351+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12741104d0 con 0x7f1274115410 2026-02-13T01:22:47.358 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.353+0000 7f126b7fe6c0 1 -- 10.20.193.55:0/1540479798 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f12580043b0 con 0x7f1274115410 2026-02-13T01:22:47.359 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.353+0000 7f126b7fe6c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f123c0b5650 0x7f123c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:47.359 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.354+0000 7f126b7fe6c0 1 -- 10.20.193.55:0/1540479798 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4661+0+0 (secure 0 0 0) 0x7f12580e2e60 con 0x7f1274115410 2026-02-13T01:22:47.359 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.354+0000 7f12725756c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f123c0b5650 0x7f123c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:47.359 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.354+0000 7f126b7fe6c0 1 -- 10.20.193.55:0/1540479798 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f12580a6600 con 0x7f1274115410 2026-02-13T01:22:47.359 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.354+0000 7f12725756c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f123c0b5650 0x7f123c0d5b00 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1260004750 tx=0x7f1260009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:47.454 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:47.452+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f127411e0b0 con 0x7f123c0b5650 2026-02-13T01:22:47.658 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 75 KiB/s, 0 objects/s recovering 2026-02-13T01:22:47.658 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T01:22:47.658 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T01:22:47.658 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:22:47.658 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:47.658 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:47.658 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:47.659 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:47.659 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:47.659 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:47.947 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 75 KiB/s, 0 objects/s recovering 2026-02-13T01:22:47.947 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T01:22:47.947 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T01:22:47.947 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:22:47.947 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:47.947 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:47.947 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:47.948 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:47.948 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:47.948 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:47.999 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:22:47 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:22:47.659+0000 7f7b876b06c0 -1 osd.6 0 waiting for initial osdmap 2026-02-13T01:22:47.999 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:22:47 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:22:47.667+0000 7f7b835746c0 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:22:48.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 75 KiB/s, 0 objects/s recovering 2026-02-13T01:22:48.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T01:22:48.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T01:22:48.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:22:48.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:48.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:48.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:48.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:48.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:48.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:48.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:48.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:22:48.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T01:22:48.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:48.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:48.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:48.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:48.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='client.? 10.20.193.55:0/833641479' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd"} : dispatch 2026-02-13T01:22:48.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd"} : dispatch 2026-02-13T01:22:48.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd"}]': finished 2026-02-13T01:22:48.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] boot 2026-02-13T01:22:48.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T01:22:48.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:48.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:48.994 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:48 trial055 ceph-mon[27509]: from='client.? 10.20.193.55:0/3672585794' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:48.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:48.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:22:48.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T01:22:48.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:48.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:48.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:48.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='client.? 10.20.193.55:0/833641479' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd"} : dispatch 2026-02-13T01:22:49.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd"} : dispatch 2026-02-13T01:22:49.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd"}]': finished 2026-02-13T01:22:49.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] boot 2026-02-13T01:22:49.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T01:22:49.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:49.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:49.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:48 trial040 ceph-mon[23046]: from='client.? 10.20.193.55:0/3672585794' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:49.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='client.? 10.20.193.55:0/833641479' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd"} : dispatch 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd"} : dispatch 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd"}]': finished 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: osd.6 [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] boot 2026-02-13T01:22:49.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T01:22:49.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:22:49.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:49.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:48 trial118 ceph-mon[27812]: from='client.? 10.20.193.55:0/3672585794' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:49.941 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:49 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:22:49.942 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:49 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:22:49.942 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:49 trial055 ceph-mon[27509]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:22:49.942 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:49 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:49.942 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:49 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:49.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:49 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:22:49.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:49 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:22:49.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:49 trial040 ceph-mon[23046]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:22:49.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:49 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:49.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:49 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:50.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:49 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:22:50.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:49 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:22:50.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:49 trial118 ceph-mon[27812]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:22:50.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:49 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:50.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:49 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:50.695 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T01:22:50.695 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:50.695 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T01:22:50.696 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:50.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T01:22:50.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:50.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:50.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:50.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:50.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:51.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:51.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:51.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:51.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:51.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:51.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T01:22:51.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:51.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:51.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T01:22:51.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:51.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:51 trial055 ceph-mon[27509]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:51.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:51 trial055 ceph-mon[27509]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:51.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:51 trial055 ceph-mon[27509]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:51.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:51 trial040 ceph-mon[23046]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:51.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:51 trial040 ceph-mon[23046]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:51.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:51 trial040 ceph-mon[23046]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:52.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:51 trial118 ceph-mon[27812]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:52.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:51 trial118 ceph-mon[27812]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:52.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:51 trial118 ceph-mon[27812]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:52.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:52 trial055 ceph-mon[27509]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:52.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:52 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:52.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:52 trial040 ceph-mon[23046]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:52.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:52 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:53.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:52 trial118 ceph-mon[27812]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:53.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:52 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:53.765 INFO:teuthology.orchestra.run.trial055.stdout:Created osd(s) 7 on host 'trial055' 2026-02-13T01:22:53.766 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.763+0000 7f126b7fe6c0 1 -- 10.20.193.55:0/1540479798 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f127411e0b0 con 0x7f123c0b5650 2026-02-13T01:22:53.768 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f123c0b5650 msgr2=0x7f123c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:53.768 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f123c0b5650 0x7f123c0d5b00 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1260004750 tx=0x7f1260009260 comp rx=0 tx=0).stop 2026-02-13T01:22:53.768 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 msgr2=0x7f127411d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:53.768 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 0x7f127411d440 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1258005dc0 tx=0x7f125800bbb0 comp rx=0 tx=0).stop 2026-02-13T01:22:53.768 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 shutdown_connections 2026-02-13T01:22:53.769 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f123c0b5650 0x7f123c0d5b00 unknown :-1 s=CLOSED pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:53.769 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1274122800 0x7f1274122ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:53.769 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1274115410 0x7f127411d440 unknown :-1 s=CLOSED pgs=49 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:53.769 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 --2- 10.20.193.55:0/1540479798 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f127410f200 0x7f127411cf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:53.769 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 >> 10.20.193.55:0/1540479798 conn(0x7f12740ecb00 msgr2=0x7f127410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:53.769 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 shutdown_connections 2026-02-13T01:22:53.769 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:22:53.765+0000 7f1278be76c0 1 -- 10.20.193.55:0/1540479798 wait complete. 2026-02-13T01:22:53.810 DEBUG:teuthology.orchestra.run.trial055:osd.7> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.7.service 2026-02-13T01:22:53.813 INFO:tasks.cephadm:Deploying osd.8 on trial118 with /dev/vg_nvme/lv_2... 2026-02-13T01:22:53.813 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T01:22:53.923 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:53.923 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.923 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.923 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.923 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.923 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:53.923 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:53.923 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.923 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:53.924 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:53.924 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:53.924 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='osd.7 [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:22:53.924 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:53 trial055 ceph-mon[27509]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:22:53.931 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:22:53.954 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:53.954 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='osd.7 [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:22:53.955 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:53 trial118 ceph-mon[27812]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:22:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:53.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:54.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:54.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:54.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:54.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='osd.7 [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:22:54.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:53 trial040 ceph-mon[23046]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:22:54.400 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:22:54.416 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial118:vg_nvme/lv_2 --skip-validation 2026-02-13T01:22:54.534 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:22:54.655 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.651+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/1071661203 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410fbf0 msgr2=0x7f3b04114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:54.655 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.651+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/1071661203 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410fbf0 0x7f3b04114c30 secure :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=3323036705722078240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec0099a0 tx=0x7f3aec02ed50 comp rx=0 tx=0).stop 2026-02-13T01:22:54.655 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.651+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/1071661203 shutdown_connections 2026-02-13T01:22:54.655 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.651+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/1071661203 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b04115410 0x7f3b04175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:54.655 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.651+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/1071661203 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410fbf0 0x7f3b04114c30 unknown :-1 s=CLOSED pgs=53 gs=1 cs=0 l=1 c_cookie=3323036705722078240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:54.655 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.651+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/1071661203 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b0410f200 0x7f3b0410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.651+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/1071661203 >> 10.20.193.118:0/1071661203 conn(0x7f3b040ecb00 msgr2=0x7f3b0410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.651+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/1071661203 shutdown_connections 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.651+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/1071661203 wait complete. 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 Processor -- start 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 -- start start 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410f200 0x7f3b0411cfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b04115410 0x7f3b0411d520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b041228e0 0x7f3b04122d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041232c0 con 0x7f3b041228e0 2026-02-13T01:22:54.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3b04123430 con 0x7f3b04115410 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041235f0 con 0x7f3b0410f200 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b093726c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410f200 0x7f3b0411cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b093726c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410f200 0x7f3b0411cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.118:60312/0 (socket says 10.20.193.118:60312) 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b093726c0 1 -- 10.20.193.118:0/4108136819 learned_addr learned my addr 10.20.193.118:0/4108136819 (peer_addr_for_me v2:10.20.193.118:0/0) 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b09b736c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b041228e0 0x7f3b04122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b093726c0 1 -- 10.20.193.118:0/4108136819 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b04115410 msgr2=0x7f3b0411d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b093726c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b04115410 0x7f3b0411d520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b093726c0 1 -- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b041228e0 msgr2=0x7f3b04122d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b093726c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b041228e0 0x7f3b04122d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b093726c0 1 -- 10.20.193.118:0/4108136819 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec009590 con 0x7f3b0410f200 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b09b736c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b041228e0 0x7f3b04122d80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:22:54.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b093726c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410f200 0x7f3b0411cfe0 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af0005dc0 tx=0x7f3af000bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:54.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b027fc6c0 1 -- 10.20.193.118:0/4108136819 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af0004250 con 0x7f3b0410f200 2026-02-13T01:22:54.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b027fc6c0 1 -- 10.20.193.118:0/4108136819 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3af0009070 con 0x7f3b0410f200 2026-02-13T01:22:54.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b027fc6c0 1 -- 10.20.193.118:0/4108136819 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af00071c0 con 0x7f3b0410f200 2026-02-13T01:22:54.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b04163a70 con 0x7f3b0410f200 2026-02-13T01:22:54.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.652+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b04163f00 con 0x7f3b0410f200 2026-02-13T01:22:54.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.653+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b041104d0 con 0x7f3b0410f200 2026-02-13T01:22:54.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.654+0000 7f3b027fc6c0 1 -- 10.20.193.118:0/4108136819 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f3af00043b0 con 0x7f3b0410f200 2026-02-13T01:22:54.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.655+0000 7f3b027fc6c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3acc0b56d0 0x7f3acc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:22:54.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.655+0000 7f3b027fc6c0 1 -- 10.20.193.118:0/4108136819 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5093+0+0 (secure 0 0 0) 0x7f3af00e2ef0 con 0x7f3b0410f200 2026-02-13T01:22:54.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.655+0000 7f3b08b716c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3acc0b56d0 0x7f3acc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:22:54.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.655+0000 7f3b027fc6c0 1 -- 10.20.193.118:0/4108136819 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3af00e33e0 con 0x7f3b0410f200 2026-02-13T01:22:54.660 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.656+0000 7f3b08b716c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3acc0b56d0 0x7f3acc0d5b80 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec0098c0 tx=0x7f3aec005be0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:22:54.752 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:22:54.751+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f3b0411e1a0 con 0x7f3acc0b56d0 2026-02-13T01:22:54.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:54.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:54.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:54.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:54.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:54.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:54.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:54.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T01:22:54.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: from='osd.7 [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:54.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T01:22:54.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:54.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:54 trial055 ceph-mon[27509]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: from='osd.7 [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T01:22:55.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:55.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:54 trial040 ceph-mon[23046]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:55.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: from='osd.7 [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T01:22:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:55.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:54 trial118 ceph-mon[27812]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:22:55.742 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:22:55 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:22:55.375+0000 7fc55542f6c0 -1 osd.7 0 waiting for initial osdmap 2026-02-13T01:22:55.743 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:22:55 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:22:55.380+0000 7fc5512f36c0 -1 osd.7 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:22:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:56.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='client.? 10.20.193.118:0/3813006628' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a727c13-2b82-4465-9c5a-af294ba75403"} : dispatch 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a727c13-2b82-4465-9c5a-af294ba75403"} : dispatch 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a727c13-2b82-4465-9c5a-af294ba75403"}]': finished 2026-02-13T01:22:56.006 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: osd.7 [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] boot 2026-02-13T01:22:56.007 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T01:22:56.007 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:56.007 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:56.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='client.? 10.20.193.118:0/3813006628' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a727c13-2b82-4465-9c5a-af294ba75403"} : dispatch 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a727c13-2b82-4465-9c5a-af294ba75403"} : dispatch 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a727c13-2b82-4465-9c5a-af294ba75403"}]': finished 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: osd.7 [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] boot 2026-02-13T01:22:56.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T01:22:56.245 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:56.245 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:56.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/3813006628' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a727c13-2b82-4465-9c5a-af294ba75403"} : dispatch 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a727c13-2b82-4465-9c5a-af294ba75403"} : dispatch 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a727c13-2b82-4465-9c5a-af294ba75403"}]': finished 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: osd.7 [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] boot 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:22:56.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:57.018 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:56 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:22:57.018 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:56 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:22:57.018 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:56 trial118 ceph-mon[27812]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:57.018 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:56 trial118 ceph-mon[27812]: from='client.? 10.20.193.118:0/1315653977' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:57.019 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:56 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:57.019 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:56 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:22:57.019 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:56 trial118 ceph-mon[27812]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T01:22:57.019 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:56 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:56 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:22:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:56 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:22:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:56 trial055 ceph-mon[27509]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:56 trial055 ceph-mon[27509]: from='client.? 10.20.193.118:0/1315653977' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:56 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:56 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:22:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:56 trial055 ceph-mon[27509]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T01:22:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:56 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:57.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:56 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:22:57.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:56 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:22:57.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:56 trial040 ceph-mon[23046]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:22:57.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:56 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/1315653977' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:22:57.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:56 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:22:57.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:56 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:22:57.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:56 trial040 ceph-mon[23046]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T01:22:57.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:56 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:57.844 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:57.844 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:57.844 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:57.844 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:57.844 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:57.844 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:57.844 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:57.844 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:57.845 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:57.845 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T01:22:57.845 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:58.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:58.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:58.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T01:22:58.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T01:22:58.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:58.964 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:58 trial118 ceph-mon[27812]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:22:58.965 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:58 trial118 ceph-mon[27812]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:22:58.965 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:58 trial118 ceph-mon[27812]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:22:58.965 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:58 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T01:22:58.965 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:58 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:58.965 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:58 trial118 ceph-mon[27812]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T01:22:58.965 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:58 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:58 trial055 ceph-mon[27509]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:22:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:58 trial055 ceph-mon[27509]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:22:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:58 trial055 ceph-mon[27509]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:22:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:58 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T01:22:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:58 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:58 trial055 ceph-mon[27509]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T01:22:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:58 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:22:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:58 trial040 ceph-mon[23046]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:22:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:58 trial040 ceph-mon[23046]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:22:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:58 trial040 ceph-mon[23046]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:22:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:58 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T01:22:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:58 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:58 trial040 ceph-mon[23046]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T01:22:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:58 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:00.023 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:59 trial118 ceph-mon[27812]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:00.024 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:59 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:00.024 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:59 trial118 ceph-mon[27812]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T01:23:00.024 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:22:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:00.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:59 trial055 ceph-mon[27509]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:00.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:59 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:00.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:59 trial055 ceph-mon[27509]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T01:23:00.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:22:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:00.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:59 trial040 ceph-mon[23046]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:00.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:59 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:00.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:59 trial040 ceph-mon[23046]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T01:23:00.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:22:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:00.984 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:00.985 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:00.985 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:00.985 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:00.985 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:00.985 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:00.985 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:00.985 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:00.985 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:00.985 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:00.986 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:01.091 INFO:teuthology.orchestra.run.trial118.stdout:Created osd(s) 8 on host 'trial118' 2026-02-13T01:23:01.091 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.089+0000 7f3b027fc6c0 1 -- 10.20.193.118:0/4108136819 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f3b0411e1a0 con 0x7f3acc0b56d0 2026-02-13T01:23:01.093 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3acc0b56d0 msgr2=0x7f3acc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:01.093 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3acc0b56d0 0x7f3acc0d5b80 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec0098c0 tx=0x7f3aec005be0 comp rx=0 tx=0).stop 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410f200 msgr2=0x7f3b0411cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410f200 0x7f3b0411cfe0 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af0005dc0 tx=0x7f3af000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 shutdown_connections 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3acc0b56d0 0x7f3acc0d5b80 unknown :-1 s=CLOSED pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b041228e0 0x7f3b04122d80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b04115410 0x7f3b0411d520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 --2- 10.20.193.118:0/4108136819 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b0410f200 0x7f3b0411cfe0 unknown :-1 s=CLOSED pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 >> 10.20.193.118:0/4108136819 conn(0x7f3b040ecb00 msgr2=0x7f3b0410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 shutdown_connections 2026-02-13T01:23:01.094 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:01.092+0000 7f3b0b6016c0 1 -- 10.20.193.118:0/4108136819 wait complete. 2026-02-13T01:23:01.137 DEBUG:teuthology.orchestra.run.trial118:osd.8> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.8.service 2026-02-13T01:23:01.139 INFO:tasks.cephadm:Deploying osd.9 on trial040 with /dev/vg_nvme/lv_1... 2026-02-13T01:23:01.140 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T01:23:01.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:01.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.194 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.195 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.195 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:01.195 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:01.195 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.195 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:01.195 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:01.195 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:01.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:01.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:01.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:01.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:01.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:01.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:01.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:01.331 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:01.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:01 trial040 ceph-mon[23046]: pgmap v107: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:01.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:01 trial040 ceph-mon[23046]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:01.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:01 trial040 ceph-mon[23046]: from='osd.8 [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:23:01.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:01 trial040 ceph-mon[23046]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:23:01.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:01 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:02.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:01 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:23:02.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:01 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:01 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:01 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:02.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:01 trial118 ceph-mon[27812]: pgmap v107: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:02.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:01 trial118 ceph-mon[27812]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:02.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:01 trial118 ceph-mon[27812]: from='osd.8 [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:23:02.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:01 trial118 ceph-mon[27812]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:23:02.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:01 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:02.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:01 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:23:02.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:01 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:01 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.005 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:01 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:02.225 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:01 trial055 ceph-mon[27509]: pgmap v107: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:01 trial055 ceph-mon[27509]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:01 trial055 ceph-mon[27509]: from='osd.8 [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:23:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:01 trial055 ceph-mon[27509]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:23:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:01 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:01 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:23:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:01 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:01 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:01 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:02.249 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial040:vg_nvme/lv_1 --skip-validation 2026-02-13T01:23:02.435 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:02.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.634+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/3732142568 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7b410f200 msgr2=0x7fd7b410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:02.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.634+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/3732142568 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7b410f200 0x7fd7b410f5d0 secure :-1 s=READY pgs=140 gs=2 cs=0 l=1 c_cookie=11479751501700378633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7a00098d0 tx=0x7fd7a002ec40 comp rx=0 tx=0).stop 2026-02-13T01:23:02.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.634+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/3732142568 shutdown_connections 2026-02-13T01:23:02.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.634+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/3732142568 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7b4115410 0x7fd7b4175db0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:02.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.634+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/3732142568 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7b410fbf0 0x7fd7b4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:02.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.634+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/3732142568 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7b410f200 0x7fd7b410f5d0 unknown :-1 s=CLOSED pgs=140 gs=2 cs=0 l=1 c_cookie=11479751501700378633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:02.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.634+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/3732142568 >> 10.20.193.40:0/3732142568 conn(0x7fd7b40ecb00 msgr2=0x7fd7b410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:02.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.634+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/3732142568 shutdown_connections 2026-02-13T01:23:02.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.634+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/3732142568 wait complete. 2026-02-13T01:23:02.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b9ea56c0 1 Processor -- start 2026-02-13T01:23:02.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b9ea56c0 1 -- start start 2026-02-13T01:23:02.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b9ea56c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7b410f200 0x7fd7b411cff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:02.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b9ea56c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7b4115410 0x7fd7b411d530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:02.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b9ea56c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7b41228f0 0x7fd7b4122d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:02.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b9ea56c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4123300 con 0x7fd7b41228f0 2026-02-13T01:23:02.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b9ea56c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4123470 con 0x7fd7b4115410 2026-02-13T01:23:02.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b9ea56c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4123630 con 0x7fd7b410f200 2026-02-13T01:23:02.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b37fe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7b410f200 0x7fd7b411cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b2ffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7b4115410 0x7fd7b411d530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b37fe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7b410f200 0x7fd7b411cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:36918/0 (socket says 10.20.193.40:36918) 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b37fe6c0 1 -- 10.20.193.40:0/2801656000 learned_addr learned my addr 10.20.193.40:0/2801656000 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.635+0000 7fd7b3fff6c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7b41228f0 0x7fd7b4122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b37fe6c0 1 -- 10.20.193.40:0/2801656000 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7b4115410 msgr2=0x7fd7b411d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b37fe6c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7b4115410 0x7fd7b411d530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b37fe6c0 1 -- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7b41228f0 msgr2=0x7fd7b4122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b37fe6c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7b41228f0 0x7fd7b4122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b37fe6c0 1 -- 10.20.193.40:0/2801656000 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a800a660 con 0x7fd7b410f200 2026-02-13T01:23:02.640 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b3fff6c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7b41228f0 0x7fd7b4122d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:02.641 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b37fe6c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7b410f200 0x7fd7b411cff0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7a0005980 tx=0x7fd7a002f750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:02.641 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b0ff96c0 1 -- 10.20.193.40:0/2801656000 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7a0005d50 con 0x7fd7b410f200 2026-02-13T01:23:02.641 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b0ff96c0 1 -- 10.20.193.40:0/2801656000 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd7a0031e40 con 0x7fd7b410f200 2026-02-13T01:23:02.641 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a00094c0 con 0x7fd7b410f200 2026-02-13T01:23:02.641 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b0ff96c0 1 -- 10.20.193.40:0/2801656000 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7a00318d0 con 0x7fd7b410f200 2026-02-13T01:23:02.641 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.636+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b4163d40 con 0x7fd7b410f200 2026-02-13T01:23:02.641 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.637+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b41104d0 con 0x7fd7b410f200 2026-02-13T01:23:02.641 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.639+0000 7fd7b0ff96c0 1 -- 10.20.193.40:0/2801656000 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fd7a00026b0 con 0x7fd7b410f200 2026-02-13T01:23:02.642 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.641+0000 7fd7b0ff96c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7880b5650 0x7fd7880d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:02.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.641+0000 7fd7b0ff96c0 1 -- 10.20.193.40:0/2801656000 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5525+0+0 (secure 0 0 0) 0x7fd7a0107290 con 0x7fd7b410f200 2026-02-13T01:23:02.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.641+0000 7fd7b2ffd6c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7880b5650 0x7fd7880d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:02.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.641+0000 7fd7b0ff96c0 1 -- 10.20.193.40:0/2801656000 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd7a0107710 con 0x7fd7b410f200 2026-02-13T01:23:02.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.642+0000 7fd7b2ffd6c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7880b5650 0x7fd7880d5b00 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7b4123980 tx=0x7fd7a4009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:02.747 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:02.746+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fd7b411e140 con 0x7fd7880b5650 2026-02-13T01:23:02.851 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:23:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:23:02.784+0000 7f51140056c0 -1 osd.8 0 waiting for initial osdmap 2026-02-13T01:23:02.851 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:23:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:23:02.790+0000 7f510fec96c0 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:02.851 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: pgmap v109: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='osd.8 [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:02.852 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:02.853 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:02.854 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:02.854 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:02 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: pgmap v109: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T01:23:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T01:23:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='osd.8 [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:02.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:03.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:03.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:03.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:03.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:03.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:02 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:03.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: pgmap v109: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:03.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T01:23:03.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T01:23:03.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='osd.8 [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:03.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:03.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:03.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:03.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:03.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:03.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:03.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:03.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:02 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:04.132 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:04.133 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='client.24496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:04.133 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:23:04.133 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T01:23:04.133 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:04.133 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:04.133 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:04.133 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:04.133 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:04.133 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:04.134 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:04.134 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:04.134 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:04.134 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:04.134 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:04.134 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:04.134 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:03 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:23:04.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:04.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='client.24496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:04.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:23:04.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T01:23:04.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:04.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:04.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:04.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:03 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='client.24496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial040:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:04.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:04.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:04.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:04.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:04.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:04.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:04.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:04.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:03 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:23:05.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:23:05.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:23:05.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:05.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:05.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: osd.8 [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] boot 2026-02-13T01:23:05.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: osdmap e51: 9 total, 9 up, 9 in 2026-02-13T01:23:05.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:05.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2477061143' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e674b08-c75c-41c1-a91b-09987dfb360c"} : dispatch 2026-02-13T01:23:05.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2477061143' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e674b08-c75c-41c1-a91b-09987dfb360c"}]': finished 2026-02-13T01:23:05.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T01:23:05.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:05.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:04 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2449334679' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:05.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:23:05.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:23:05.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:05.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:05.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: osd.8 [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] boot 2026-02-13T01:23:05.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: osdmap e51: 9 total, 9 up, 9 in 2026-02-13T01:23:05.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:05.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2477061143' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e674b08-c75c-41c1-a91b-09987dfb360c"} : dispatch 2026-02-13T01:23:05.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2477061143' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e674b08-c75c-41c1-a91b-09987dfb360c"}]': finished 2026-02-13T01:23:05.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T01:23:05.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:05.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:04 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2449334679' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:05.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: osd.8 [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] boot 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: osdmap e51: 9 total, 9 up, 9 in 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2477061143' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e674b08-c75c-41c1-a91b-09987dfb360c"} : dispatch 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2477061143' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e674b08-c75c-41c1-a91b-09987dfb360c"}]': finished 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:05.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:04 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2449334679' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:06 trial040 ceph-mon[23046]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:23:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:06 trial040 ceph-mon[23046]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T01:23:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:06 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:06.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:06 trial055 ceph-mon[27509]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:23:06.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:06 trial055 ceph-mon[27509]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T01:23:06.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:06 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:06.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:06 trial118 ceph-mon[27812]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:23:06.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:06 trial118 ceph-mon[27812]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T01:23:06.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:06 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:07.157 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:07 trial040 ceph-mon[23046]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T01:23:07.158 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:07 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:07.158 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:07 trial040 ceph-mon[23046]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T01:23:07.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:07 trial055 ceph-mon[27509]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T01:23:07.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:07 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:07.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:07 trial055 ceph-mon[27509]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T01:23:07.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:07 trial118 ceph-mon[27812]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T01:23:07.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:07 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:07.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:07 trial118 ceph-mon[27812]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T01:23:08.287 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:08 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:08.287 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:08 trial040 ceph-mon[23046]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T01:23:08.287 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:08.288 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T01:23:08.288 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:08 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:08.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:08 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:08.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:08 trial055 ceph-mon[27509]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T01:23:08.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:08.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T01:23:08.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:08 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:08.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:08 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:08.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:08 trial118 ceph-mon[27812]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T01:23:08.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:08.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T01:23:08.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:08 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:09.393 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:09 trial055 ceph-mon[27509]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T01:23:09.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:09 trial040 ceph-mon[23046]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T01:23:09.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:09 trial118 ceph-mon[27812]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T01:23:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:11 trial055 ceph-mon[27509]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 100 KiB/s, 0 objects/s recovering 2026-02-13T01:23:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:11 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:11 trial040 ceph-mon[23046]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 100 KiB/s, 0 objects/s recovering 2026-02-13T01:23:12.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:12.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:11 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:11 trial118 ceph-mon[27812]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 100 KiB/s, 0 objects/s recovering 2026-02-13T01:23:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:11 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.485 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.483+0000 7fd7b0ff96c0 1 -- 10.20.193.40:0/2801656000 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fd7b411e140 con 0x7fd7880b5650 2026-02-13T01:23:12.485 INFO:teuthology.orchestra.run.trial040.stdout:Created osd(s) 9 on host 'trial040' 2026-02-13T01:23:12.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7880b5650 msgr2=0x7fd7880d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:12.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7880b5650 0x7fd7880d5b00 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7b4123980 tx=0x7fd7a4009260 comp rx=0 tx=0).stop 2026-02-13T01:23:12.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7b410f200 msgr2=0x7fd7b411cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:12.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7b410f200 0x7fd7b411cff0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7a0005980 tx=0x7fd7a002f750 comp rx=0 tx=0).stop 2026-02-13T01:23:12.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 shutdown_connections 2026-02-13T01:23:12.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7880b5650 0x7fd7880d5b00 unknown :-1 s=CLOSED pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:12.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7b41228f0 0x7fd7b4122d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:12.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7b4115410 0x7fd7b411d530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:12.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 --2- 10.20.193.40:0/2801656000 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7b410f200 0x7fd7b411cff0 unknown :-1 s=CLOSED pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:12.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 >> 10.20.193.40:0/2801656000 conn(0x7fd7b40ecb00 msgr2=0x7fd7b410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:12.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 shutdown_connections 2026-02-13T01:23:12.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:12.486+0000 7fd7b9ea56c0 1 -- 10.20.193.40:0/2801656000 wait complete. 2026-02-13T01:23:12.633 DEBUG:teuthology.orchestra.run.trial040:osd.9> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.9.service 2026-02-13T01:23:12.637 INFO:tasks.cephadm:Deploying osd.10 on trial055 with /dev/vg_nvme/lv_1... 2026-02-13T01:23:12.637 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T01:23:12.756 INFO:teuthology.orchestra.run.trial055.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.b/config 2026-02-13T01:23:12.913 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='osd.9 [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:23:12.913 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:23:12.913 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.913 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.913 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:12.913 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:12.914 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.914 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:12.914 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:12.914 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:12.914 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.914 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:12 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.918 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='osd.9 [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:12.919 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:12 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:13.199 INFO:teuthology.orchestra.run.trial055.stdout: 2026-02-13T01:23:13.216 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial055:vg_nvme/lv_1 --skip-validation 2026-02-13T01:23:13.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='osd.9 [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:23:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:23:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:13.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:13.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:13.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:12 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:13.337 INFO:teuthology.orchestra.run.trial055.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.b/config 2026-02-13T01:23:13.463 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 -- 10.20.193.55:0/2371926699 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f010f230 msgr2=0x7f46f010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:13.464 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/2371926699 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f010f230 0x7f46f010f600 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=11590773212056411181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46dc009970 tx=0x7f46dc02ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:13.464 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 -- 10.20.193.55:0/2371926699 shutdown_connections 2026-02-13T01:23:13.464 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/2371926699 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46f0115440 0x7f46f0175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:13.464 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/2371926699 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46f010fc20 0x7f46f0114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:13.464 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/2371926699 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f010f230 0x7f46f010f600 unknown :-1 s=CLOSED pgs=59 gs=1 cs=0 l=1 c_cookie=11590773212056411181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:13.464 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 -- 10.20.193.55:0/2371926699 >> 10.20.193.55:0/2371926699 conn(0x7f46f00ecb30 msgr2=0x7f46f010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:13.464 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 -- 10.20.193.55:0/2371926699 shutdown_connections 2026-02-13T01:23:13.464 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 -- 10.20.193.55:0/2371926699 wait complete. 2026-02-13T01:23:13.464 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 Processor -- start 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 -- start start 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46f010f230 0x7f46f011d000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f0115440 0x7f46f011d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46f0122900 0x7f46f0122da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0123310 con 0x7f46f010f230 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0123480 con 0x7f46f0115440 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.458+0000 7f46f5c356c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0123640 con 0x7f46f0122900 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46eeffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f0115440 0x7f46f011d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46eeffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f0115440 0x7f46f011d540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.55:49920/0 (socket says 10.20.193.55:49920) 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46eeffd6c0 1 -- 10.20.193.55:0/1140767899 learned_addr learned my addr 10.20.193.55:0/1140767899 (peer_addr_for_me v2:10.20.193.55:0/0) 2026-02-13T01:23:13.465 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46ef7fe6c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46f010f230 0x7f46f011d000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46effff6c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46f0122900 0x7f46f0122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46eeffd6c0 1 -- 10.20.193.55:0/1140767899 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46f0122900 msgr2=0x7f46f0122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46eeffd6c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46f0122900 0x7f46f0122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46eeffd6c0 1 -- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46f010f230 msgr2=0x7f46f011d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46eeffd6c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46f010f230 0x7f46f011d000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46eeffd6c0 1 -- 10.20.193.55:0/1140767899 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc009590 con 0x7f46f0115440 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46effff6c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46f0122900 0x7f46f0122da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46eeffd6c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f0115440 0x7f46f011d540 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46d800b800 tx=0x7f46d800bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46ecff96c0 1 -- 10.20.193.55:0/1140767899 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46d8004a80 con 0x7f46f0115440 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46ecff96c0 1 -- 10.20.193.55:0/1140767899 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f46d8009070 con 0x7f46f0115440 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f0163af0 con 0x7f46f0115440 2026-02-13T01:23:13.466 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46ecff96c0 1 -- 10.20.193.55:0/1140767899 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46d80071c0 con 0x7f46f0115440 2026-02-13T01:23:13.467 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f0163fd0 con 0x7f46f0115440 2026-02-13T01:23:13.467 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.459+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f0110500 con 0x7f46f0115440 2026-02-13T01:23:13.467 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.460+0000 7f46ecff96c0 1 -- 10.20.193.55:0/1140767899 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f46d8004060 con 0x7f46f0115440 2026-02-13T01:23:13.468 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.461+0000 7f46ecff96c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46b80b56d0 0x7f46b80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:13.468 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.461+0000 7f46ecff96c0 1 -- 10.20.193.55:0/1140767899 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5957+0+0 (secure 0 0 0) 0x7f46d80e32b0 con 0x7f46f0115440 2026-02-13T01:23:13.468 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.461+0000 7f46ef7fe6c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46b80b56d0 0x7f46b80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:13.468 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.461+0000 7f46ecff96c0 1 -- 10.20.193.55:0/1140767899 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f46d80a6540 con 0x7f46f0115440 2026-02-13T01:23:13.468 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.462+0000 7f46ef7fe6c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46b80b56d0 0x7f46b80d5b80 secure :-1 s=READY pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46dc0098c0 tx=0x7f46dc005c40 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:13.562 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:13.558+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f46f010fc20 con 0x7f46b80b56d0 2026-02-13T01:23:14.052 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 80 KiB/s, 0 objects/s recovering 2026-02-13T01:23:14.052 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T01:23:14.052 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='osd.9 [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:23:14.052 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T01:23:14.052 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:14.052 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:23:14.052 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:14.052 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:23:14.053 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:14.053 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:14.053 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:14.053 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:14.053 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:14.053 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:13 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:14.053 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:23:13 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:23:13.798+0000 7fced9a116c0 -1 osd.9 0 waiting for initial osdmap 2026-02-13T01:23:14.053 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:23:13 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:23:13.807+0000 7fced58d56c0 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:14.055 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 80 KiB/s, 0 objects/s recovering 2026-02-13T01:23:14.055 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T01:23:14.055 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='osd.9 [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:23:14.055 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T01:23:14.055 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:14.055 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:23:14.055 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:14.055 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:23:14.055 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:14.056 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:14.056 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:14.056 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:14.056 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:14.056 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:13 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:14.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 80 KiB/s, 0 objects/s recovering 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='osd.9 [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial040", "root=default"]} : dispatch 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:14.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:14.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:14.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:13 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:14.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:23:14.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:14.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:23:14.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T01:23:14.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='client.? 10.20.193.55:0/227218818' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0253c41-b910-4637-aae8-5c00bc814dbe"} : dispatch 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0253c41-b910-4637-aae8-5c00bc814dbe"} : dispatch 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0253c41-b910-4637-aae8-5c00bc814dbe"}]': finished 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: osd.9 [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] boot 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: osdmap e58: 11 total, 10 up, 11 in 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='client.? 10.20.193.55:0/1817263161' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:15.000 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:15.001 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:14 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:15.075 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:23:15.075 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:15.075 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:23:15.075 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T01:23:15.075 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:15.075 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:15.075 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='client.? 10.20.193.55:0/227218818' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0253c41-b910-4637-aae8-5c00bc814dbe"} : dispatch 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0253c41-b910-4637-aae8-5c00bc814dbe"} : dispatch 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0253c41-b910-4637-aae8-5c00bc814dbe"}]': finished 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: osd.9 [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] boot 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: osdmap e58: 11 total, 10 up, 11 in 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='client.? 10.20.193.55:0/1817263161' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:15.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:15.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:15.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:15.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:14 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:15.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:23:15.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial055:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:15.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial040", "root=default"]}]': finished 2026-02-13T01:23:15.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T01:23:15.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:15.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:15.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:15.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='client.? 10.20.193.55:0/227218818' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0253c41-b910-4637-aae8-5c00bc814dbe"} : dispatch 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0253c41-b910-4637-aae8-5c00bc814dbe"} : dispatch 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0253c41-b910-4637-aae8-5c00bc814dbe"}]': finished 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: osd.9 [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] boot 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: osdmap e58: 11 total, 10 up, 11 in 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='client.? 10.20.193.55:0/1817263161' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:15.256 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.256 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:15.256 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:15.256 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:15.256 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:15.256 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:15.256 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:14 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:16.076 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:15 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:23:16.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:15 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:23:16.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:15 trial055 ceph-mon[27509]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:23:16.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:15 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:16.077 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:15 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:23:16.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:15 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:23:16.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:15 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:23:16.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:15 trial040 ceph-mon[23046]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:23:16.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:15 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:16.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:15 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:23:16.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:15 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:23:16.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:15 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:23:16.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:15 trial118 ceph-mon[27812]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:23:16.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:15 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:16.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:15 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:23:16.890 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T01:23:16.890 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:16.890 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:16.890 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:16.891 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:16.891 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:16.891 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:16.891 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:16.891 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:16.891 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:16.891 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:16.891 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T01:23:16.891 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:16 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:17.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T01:23:17.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:17.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:17.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:17.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:17.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:17.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:17.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:17.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:17.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:17.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:17.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T01:23:17.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:16 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:17.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:17.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T01:23:17.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:16 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:18.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:17 trial055 ceph-mon[27509]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:18.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:17 trial055 ceph-mon[27509]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:18.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:17 trial040 ceph-mon[23046]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:18.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:17 trial040 ceph-mon[23046]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:18.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:17 trial118 ceph-mon[27812]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:18.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:17 trial118 ceph-mon[27812]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:19.162 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:18 trial055 ceph-mon[27509]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:19.162 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:18 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:19.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:18 trial040 ceph-mon[23046]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:19.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:18 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:19.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:18 trial118 ceph-mon[27812]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:19.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:18 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:20.022 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.020+0000 7f46ecff96c0 1 -- 10.20.193.55:0/1140767899 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f46f010fc20 con 0x7f46b80b56d0 2026-02-13T01:23:20.023 INFO:teuthology.orchestra.run.trial055.stdout:Created osd(s) 10 on host 'trial055' 2026-02-13T01:23:20.025 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46b80b56d0 msgr2=0x7f46b80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:20.025 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46b80b56d0 0x7f46b80d5b80 secure :-1 s=READY pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46dc0098c0 tx=0x7f46dc005c40 comp rx=0 tx=0).stop 2026-02-13T01:23:20.025 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f0115440 msgr2=0x7f46f011d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:20.025 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f0115440 0x7f46f011d540 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46d800b800 tx=0x7f46d800bcd0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.026 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 shutdown_connections 2026-02-13T01:23:20.026 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46b80b56d0 0x7f46b80d5b80 unknown :-1 s=CLOSED pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.026 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46f0122900 0x7f46f0122da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.026 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46f0115440 0x7f46f011d540 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.026 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 --2- 10.20.193.55:0/1140767899 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46f010f230 0x7f46f011d000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.026 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 >> 10.20.193.55:0/1140767899 conn(0x7f46f00ecb30 msgr2=0x7f46f010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:20.026 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.022+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 shutdown_connections 2026-02-13T01:23:20.026 INFO:teuthology.orchestra.run.trial055.stderr:2026-02-13T01:23:20.023+0000 7f46f5c356c0 1 -- 10.20.193.55:0/1140767899 wait complete. 2026-02-13T01:23:20.064 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:20.064 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.064 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.064 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.064 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.064 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:20.064 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:20.064 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.065 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:20.065 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:20.065 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:19 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:20.066 DEBUG:teuthology.orchestra.run.trial055:osd.10> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.10.service 2026-02-13T01:23:20.068 INFO:tasks.cephadm:Deploying osd.11 on trial118 with /dev/vg_nvme/lv_1... 2026-02-13T01:23:20.069 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:20.094 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:20.095 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:19 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:20.189 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:20.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:19 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:20.618 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-13T01:23:20.636 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch daemon add osd trial118:vg_nvme/lv_1 --skip-validation 2026-02-13T01:23:20.793 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:23:20.916 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/2795150379 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 msgr2=0x7fdc08175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:20.916 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/2795150379 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 0x7fdc08175db0 secure :-1 s=READY pgs=63 gs=1 cs=0 l=1 c_cookie=7389052570005854700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbf800aa70 tx=0x7fdbf802fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.916 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/2795150379 shutdown_connections 2026-02-13T01:23:20.916 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/2795150379 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 0x7fdc08175db0 unknown :-1 s=CLOSED pgs=63 gs=1 cs=0 l=1 c_cookie=7389052570005854700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.916 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/2795150379 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc0810fbf0 0x7fdc08114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.916 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/2795150379 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdc0810f200 0x7fdc0810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.916 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/2795150379 >> 10.20.193.118:0/2795150379 conn(0x7fdc080ecb00 msgr2=0x7fdc0810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:20.916 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/2795150379 shutdown_connections 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/2795150379 wait complete. 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 Processor -- start 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.911+0000 7fdc0cc696c0 1 -- start start 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc0cc696c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc0810f200 0x7fdc0811cff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc0cc696c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 0x7fdc0811d530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc0cc696c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdc081228f0 0x7fdc08122d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc0cc696c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdc08123300 con 0x7fdc0810f200 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc0cc696c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fdc08123470 con 0x7fdc081228f0 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc0cc696c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdc08123630 con 0x7fdc08115410 2026-02-13T01:23:20.917 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc05d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 0x7fdc0811d530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc05d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 0x7fdc0811d530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.118:35120/0 (socket says 10.20.193.118:35120) 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc05d746c0 1 -- 10.20.193.118:0/3475013119 learned_addr learned my addr 10.20.193.118:0/3475013119 (peer_addr_for_me v2:10.20.193.118:0/0) 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc065756c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc0810f200 0x7fdc0811cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc06d766c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdc081228f0 0x7fdc08122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc05d746c0 1 -- 10.20.193.118:0/3475013119 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdc081228f0 msgr2=0x7fdc08122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc05d746c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdc081228f0 0x7fdc08122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc05d746c0 1 -- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc0810f200 msgr2=0x7fdc0811cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc05d746c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc0810f200 0x7fdc0811cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc05d746c0 1 -- 10.20.193.118:0/3475013119 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf800a660 con 0x7fdc08115410 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc065756c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc0810f200 0x7fdc0811cff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc05d746c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 0x7fdc0811d530 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbec005dc0 tx=0x7fdbec00bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:20.918 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdbff7fe6c0 1 -- 10.20.193.118:0/3475013119 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdbec004250 con 0x7fdc08115410 2026-02-13T01:23:20.919 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc08163ae0 con 0x7fdc08115410 2026-02-13T01:23:20.919 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdbff7fe6c0 1 -- 10.20.193.118:0/3475013119 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fdbec009070 con 0x7fdc08115410 2026-02-13T01:23:20.919 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdbff7fe6c0 1 -- 10.20.193.118:0/3475013119 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdbec0071c0 con 0x7fdc08115410 2026-02-13T01:23:20.919 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.912+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc08163fc0 con 0x7fdc08115410 2026-02-13T01:23:20.919 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.913+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc081104d0 con 0x7fdc08115410 2026-02-13T01:23:20.920 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.914+0000 7fdbff7fe6c0 1 -- 10.20.193.118:0/3475013119 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fdbec0043b0 con 0x7fdc08115410 2026-02-13T01:23:20.920 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.915+0000 7fdbff7fe6c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdbd00b5650 0x7fdbd00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:20.920 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.915+0000 7fdbff7fe6c0 1 -- 10.20.193.118:0/3475013119 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6390+0+0 (secure 0 0 0) 0x7fdbec0e3440 con 0x7fdc08115410 2026-02-13T01:23:20.920 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.915+0000 7fdc065756c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdbd00b5650 0x7fdbd00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:20.920 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.915+0000 7fdbff7fe6c0 1 -- 10.20.193.118:0/3475013119 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdbec0a6560 con 0x7fdc08115410 2026-02-13T01:23:20.920 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:20.915+0000 7fdc065756c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdbd00b5650 0x7fdbd00d5b00 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbf4005dc0 tx=0x7fdbf4005f90 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:20.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:20 trial055 ceph-mon[27509]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:20.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:20 trial055 ceph-mon[27509]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:20.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:20 trial055 ceph-mon[27509]: from='osd.10 [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:23:20.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:20 trial055 ceph-mon[27509]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:23:20.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:20 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:20.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:20 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:23:20.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:20.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:20 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:21.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:20 trial118 ceph-mon[27812]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:21.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:20 trial118 ceph-mon[27812]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:21.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:20 trial118 ceph-mon[27812]: from='osd.10 [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:23:21.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:20 trial118 ceph-mon[27812]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:23:21.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:20 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:21.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:20 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:23:21.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:20 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:21.014 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:21.012+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fdc0811e1d0 con 0x7fdbd00b5650 2026-02-13T01:23:21.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:20 trial040 ceph-mon[23046]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:21.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:20 trial040 ceph-mon[23046]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:21.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:20 trial040 ceph-mon[23046]: from='osd.10 [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:23:21.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:20 trial040 ceph-mon[23046]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:23:21.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:20 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:21.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:20 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:23:21.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:20 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:21.934 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:21.934 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T01:23:21.934 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='osd.10 [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:23:21.934 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T01:23:21.934 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:21.934 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:23:21.934 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:21.935 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.936 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:21.936 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:21.936 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:21.936 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:21.936 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:21.936 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:21 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:22.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:22.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T01:23:22.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='osd.10 [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:22.244 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:21 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:22.245 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:23:21 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:23:21.817+0000 7f7c82fb96c0 -1 osd.10 0 waiting for initial osdmap 2026-02-13T01:23:22.245 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:23:21 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:23:21.825+0000 7f7c7ee7d6c0 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:22.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:22.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T01:23:22.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='osd.10 [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:23:22.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T01:23:22.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:22.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial055", "root=default"]} : dispatch 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:22.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:22.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:22.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:22.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:22.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:22.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:22.251 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:21 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:23.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:23.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:23:23.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T01:23:23.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:23.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:23.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='client.? 10.20.193.118:0/383495484' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de7616d6-df2d-4ade-8676-6c4e95da253c"} : dispatch 2026-02-13T01:23:23.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de7616d6-df2d-4ade-8676-6c4e95da253c"} : dispatch 2026-02-13T01:23:23.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de7616d6-df2d-4ade-8676-6c4e95da253c"}]': finished 2026-02-13T01:23:23.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: osd.10 [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] boot 2026-02-13T01:23:23.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T01:23:23.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:23.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:23.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: from='client.? 10.20.193.118:0/2716796502' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:23.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:23.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:22 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:23:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:23:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T01:23:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/383495484' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de7616d6-df2d-4ade-8676-6c4e95da253c"} : dispatch 2026-02-13T01:23:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de7616d6-df2d-4ade-8676-6c4e95da253c"} : dispatch 2026-02-13T01:23:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de7616d6-df2d-4ade-8676-6c4e95da253c"}]': finished 2026-02-13T01:23:23.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: osd.10 [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] boot 2026-02-13T01:23:23.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T01:23:23.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:23.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:23.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: from='client.? 10.20.193.118:0/2716796502' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:23.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:23.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:22 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial118:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial055", "root=default"]}]': finished 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='client.? 10.20.193.118:0/383495484' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de7616d6-df2d-4ade-8676-6c4e95da253c"} : dispatch 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de7616d6-df2d-4ade-8676-6c4e95da253c"} : dispatch 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de7616d6-df2d-4ade-8676-6c4e95da253c"}]': finished 2026-02-13T01:23:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: osd.10 [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] boot 2026-02-13T01:23:23.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T01:23:23.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:23:23.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:23.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: from='client.? 10.20.193.118:0/2716796502' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:23.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:23.255 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:22 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:23:24.096 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:23:24.096 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:23:24.096 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T01:23:24.096 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:24.097 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:24.098 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:23 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:23:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:23:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T01:23:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:24.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:24.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:24.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:24.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:24.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:24.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:24.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:24.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:23 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:23:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:23:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T01:23:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:24.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:24.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:24.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:24.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:24.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:24.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:24.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:23 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.991 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:24 trial118 ceph-mon[27812]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T01:23:24.991 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:24.991 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T01:23:24.991 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.991 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:24 trial118 ceph-mon[27812]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T01:23:24.991 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:24 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:24.991 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:24 trial118 ceph-mon[27812]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:25.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:24 trial055 ceph-mon[27509]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T01:23:25.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:25.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T01:23:25.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:25.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:24 trial055 ceph-mon[27509]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T01:23:25.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:24 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:25.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:24 trial055 ceph-mon[27509]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:25.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:24 trial040 ceph-mon[23046]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T01:23:25.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:25.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T01:23:25.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:25.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:24 trial040 ceph-mon[23046]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T01:23:25.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:24 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:25.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:24 trial040 ceph-mon[23046]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:26.149 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:25 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:26.149 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:25 trial118 ceph-mon[27812]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T01:23:26.149 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:25 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:26.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:25 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:26.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:25 trial055 ceph-mon[27509]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T01:23:26.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:25 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:26.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:25 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:26.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:25 trial040 ceph-mon[23046]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T01:23:26.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:25 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:27.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:26 trial118 ceph-mon[27812]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T01:23:27.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:26 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:27.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:26 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:27.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:26 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:27.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:26 trial055 ceph-mon[27509]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T01:23:27.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:26 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:27.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:26 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:27.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:26 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:27.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:26 trial040 ceph-mon[23046]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T01:23:27.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:26 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:27.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:26 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:27.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:26 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:27.466 INFO:teuthology.orchestra.run.trial118.stdout:Created osd(s) 11 on host 'trial118' 2026-02-13T01:23:27.467 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.464+0000 7fdbff7fe6c0 1 -- 10.20.193.118:0/3475013119 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdbf4004020 con 0x7fdbd00b5650 2026-02-13T01:23:27.469 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdbd00b5650 msgr2=0x7fdbd00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:27.469 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdbd00b5650 0x7fdbd00d5b00 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbf4005dc0 tx=0x7fdbf4005f90 comp rx=0 tx=0).stop 2026-02-13T01:23:27.469 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 msgr2=0x7fdc0811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:27.469 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 0x7fdc0811d530 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbec005dc0 tx=0x7fdbec00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.469 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 shutdown_connections 2026-02-13T01:23:27.469 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fdbd00b5650 0x7fdbd00d5b00 unknown :-1 s=CLOSED pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.469 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fdc081228f0 0x7fdc08122d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.469 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fdc08115410 0x7fdc0811d530 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.470 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 --2- 10.20.193.118:0/3475013119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc0810f200 0x7fdc0811cff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.470 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 >> 10.20.193.118:0/3475013119 conn(0x7fdc080ecb00 msgr2=0x7fdc0810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:27.470 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 shutdown_connections 2026-02-13T01:23:27.470 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:27.466+0000 7fdc0cc696c0 1 -- 10.20.193.118:0/3475013119 wait complete. 2026-02-13T01:23:27.512 DEBUG:teuthology.orchestra.run.trial118:osd.11> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.11.service 2026-02-13T01:23:27.514 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-13T01:23:27.514 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T01:23:27.702 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:27.911 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.909+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/1325865948 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f301410d7d0 msgr2=0x7f3014112810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:27.911 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.909+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/1325865948 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f301410d7d0 0x7f3014112810 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=17048197544163182237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30080099a0 tx=0x7f300802ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:27.911 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.909+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/1325865948 shutdown_connections 2026-02-13T01:23:27.911 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.909+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/1325865948 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3014112ff0 0x7f3014173990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.911 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.909+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/1325865948 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f301410d7d0 0x7f3014112810 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=17048197544163182237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.911 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.909+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/1325865948 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f301410cde0 0x7f301410d1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.911 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.909+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/1325865948 >> 10.20.193.40:0/1325865948 conn(0x7f30140ea6a0 msgr2=0x7f301410aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:27.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.910+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/1325865948 shutdown_connections 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.910+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/1325865948 wait complete. 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f301a1ae6c0 1 Processor -- start 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f301a1ae6c0 1 -- start start 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f301a1ae6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f301410cde0 0x7f3014060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f301a1ae6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3014112ff0 0x7f3014173890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f301a1ae6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3014060c40 0x7f30140610e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f301a1ae6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3014062640 con 0x7f3014112ff0 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f301a1ae6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f30140fa7c0 con 0x7f3014060c40 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f301a1ae6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f30140fa980 con 0x7f301410cde0 2026-02-13T01:23:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f30189ab6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3014112ff0 0x7f3014173890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f30189ab6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3014112ff0 0x7f3014173890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:37804/0 (socket says 10.20.193.40:37804) 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f30189ab6c0 1 -- 10.20.193.40:0/2202277276 learned_addr learned my addr 10.20.193.40:0/2202277276 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.911+0000 7f30191ac6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f301410cde0 0x7f3014060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30199ad6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3014060c40 0x7f30140610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30189ab6c0 1 -- 10.20.193.40:0/2202277276 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f301410cde0 msgr2=0x7f3014060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30189ab6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f301410cde0 0x7f3014060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30189ab6c0 1 -- 10.20.193.40:0/2202277276 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3014060c40 msgr2=0x7f30140610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30189ab6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3014060c40 0x7f30140610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30189ab6c0 1 -- 10.20.193.40:0/2202277276 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3008009590 con 0x7f3014112ff0 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30199ad6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3014060c40 0x7f30140610e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30189ab6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3014112ff0 0x7f3014173890 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3008005b40 tx=0x7f30080047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30027fc6c0 1 -- 10.20.193.40:0/2202277276 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f300802f9e0 con 0x7f3014112ff0 2026-02-13T01:23:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30027fc6c0 1 -- 10.20.193.40:0/2202277276 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3008002be0 con 0x7f3014112ff0 2026-02-13T01:23:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f30027fc6c0 1 -- 10.20.193.40:0/2202277276 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3008007670 con 0x7f3014112ff0 2026-02-13T01:23:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30140fac00 con 0x7f3014112ff0 2026-02-13T01:23:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.912+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30140fb030 con 0x7f3014112ff0 2026-02-13T01:23:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.913+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f301410e0b0 con 0x7f3014112ff0 2026-02-13T01:23:27.917 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.916+0000 7f30027fc6c0 1 -- 10.20.193.40:0/2202277276 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f30080026b0 con 0x7f3014112ff0 2026-02-13T01:23:27.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.917+0000 7f30027fc6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ff00b56d0 0x7f2ff00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:27.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.917+0000 7f30027fc6c0 1 -- 10.20.193.40:0/2202277276 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6801+0+0 (secure 0 0 0) 0x7f3008107a00 con 0x7f3014112ff0 2026-02-13T01:23:27.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.918+0000 7f30027fc6c0 1 -- 10.20.193.40:0/2202277276 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f30081405e0 con 0x7f3014112ff0 2026-02-13T01:23:27.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.918+0000 7f30191ac6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ff00b56d0 0x7f2ff00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:27.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:27.918+0000 7f30191ac6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ff00b56d0 0x7f2ff00d5b80 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3004006b60 tx=0x7f3004006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:28.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.035+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3014061a00 con 0x7f3014112ff0 2026-02-13T01:23:28.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.035+0000 7f30027fc6c0 1 -- 10.20.193.40:0/2202277276 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f30080ca940 con 0x7f3014112ff0 2026-02-13T01:23:28.037 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:28.038 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ff00b56d0 msgr2=0x7f2ff00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:28.038 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ff00b56d0 0x7f2ff00d5b80 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3004006b60 tx=0x7f3004006af0 comp rx=0 tx=0).stop 2026-02-13T01:23:28.038 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3014112ff0 msgr2=0x7f3014173890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:28.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3014112ff0 0x7f3014173890 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3008005b40 tx=0x7f30080047f0 comp rx=0 tx=0).stop 2026-02-13T01:23:28.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 shutdown_connections 2026-02-13T01:23:28.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2ff00b56d0 0x7f2ff00d5b80 unknown :-1 s=CLOSED pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:28.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3014060c40 0x7f30140610e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:28.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3014112ff0 0x7f3014173890 unknown :-1 s=CLOSED pgs=147 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:28.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 --2- 10.20.193.40:0/2202277276 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f301410cde0 0x7f3014060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:28.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 >> 10.20.193.40:0/2202277276 conn(0x7f30140ea6a0 msgr2=0x7f301410b260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:28.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 shutdown_connections 2026-02-13T01:23:28.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:28.037+0000 7f301a1ae6c0 1 -- 10.20.193.40:0/2202277276 wait complete. 2026-02-13T01:23:28.142 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1770945801,"num_in_osds":12,"osd_in_since":1770945801,"num_remapped_pgs":0} 2026-02-13T01:23:28.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:28.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T01:23:28.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:28.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:28.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='osd.11 [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:23:28.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:23:28.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:23:28.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:28.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:28 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2202277276' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:23:28.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:28.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T01:23:28.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:28.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:28.500 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.500 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='osd.11 [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:23:28.500 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:23:28.500 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.500 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.500 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:23:28.500 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:28.500 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:28 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2202277276' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:23:28.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:28.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T01:23:28.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:28.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:28.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='osd.11 [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:23:28.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:23:28.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:28.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:23:28.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:28.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:28 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2202277276' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:23:29.143 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T01:23:29.190 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T01:23:29.190 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='osd.11 [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:29.191 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:29.192 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.192 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail; 137 KiB/s, 0 objects/s recovering 2026-02-13T01:23:29.192 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:29.192 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:29.192 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:29 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:29.192 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:23:29 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:23:29.096+0000 7fdbe56716c0 -1 osd.11 0 waiting for initial osdmap 2026-02-13T01:23:29.192 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:23:29 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:23:29.104+0000 7fdbdd52d6c0 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:29.330 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:29.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T01:23:29.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T01:23:29.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:29.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='osd.11 [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:29.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:29.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.373 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail; 137 KiB/s, 0 objects/s recovering 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:29.374 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:29 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='osd.11 [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial118", "root=default"]} : dispatch 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:29.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:29.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:29.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:29.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail; 137 KiB/s, 0 objects/s recovering 2026-02-13T01:23:29.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:29.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:29.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:29 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.523+0000 7f1febfff6c0 1 -- 10.20.193.40:0/902430667 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1fec10fa50 msgr2=0x7f1fec114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.523+0000 7f1febfff6c0 1 --2- 10.20.193.40:0/902430667 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1fec10fa50 0x7f1fec114a90 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=11378466390893800961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fd40099a0 tx=0x7f1fd402ed00 comp rx=0 tx=0).stop 2026-02-13T01:23:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.523+0000 7f1febfff6c0 1 -- 10.20.193.40:0/902430667 shutdown_connections 2026-02-13T01:23:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.523+0000 7f1febfff6c0 1 --2- 10.20.193.40:0/902430667 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1fec115270 0x7f1fec175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.523+0000 7f1febfff6c0 1 --2- 10.20.193.40:0/902430667 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1fec10fa50 0x7f1fec114a90 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=11378466390893800961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.523+0000 7f1febfff6c0 1 --2- 10.20.193.40:0/902430667 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1fec10f060 0x7f1fec10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.523+0000 7f1febfff6c0 1 -- 10.20.193.40:0/902430667 >> 10.20.193.40:0/902430667 conn(0x7f1fec0ec980 msgr2=0x7f1fec10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.523+0000 7f1febfff6c0 1 -- 10.20.193.40:0/902430667 shutdown_connections 2026-02-13T01:23:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.523+0000 7f1febfff6c0 1 -- 10.20.193.40:0/902430667 wait complete. 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.524+0000 7f1febfff6c0 1 Processor -- start 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.524+0000 7f1febfff6c0 1 -- start start 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1febfff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1fec10f060 0x7f1fec0f4800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1febfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1fec115270 0x7f1fec175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1febfff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1fec0f4e30 0x7f1fec0fa100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1febfff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0f5520 con 0x7f1fec0f4e30 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1febfff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0fa640 con 0x7f1fec115270 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1febfff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0fa800 con 0x7f1fec10f060 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feaffd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1fec10f060 0x7f1fec0f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feaffd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1fec10f060 0x7f1fec0f4800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:34706/0 (socket says 10.20.193.40:34706) 2026-02-13T01:23:29.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feaffd6c0 1 -- 10.20.193.40:0/3501252561 learned_addr learned my addr 10.20.193.40:0/3501252561 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1fea7fc6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1fec115270 0x7f1fec175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feb7fe6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1fec0f4e30 0x7f1fec0fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feaffd6c0 1 -- 10.20.193.40:0/3501252561 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1fec115270 msgr2=0x7f1fec175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feaffd6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1fec115270 0x7f1fec175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feaffd6c0 1 -- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1fec0f4e30 msgr2=0x7f1fec0fa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feaffd6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1fec0f4e30 0x7f1fec0fa100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feaffd6c0 1 -- 10.20.193.40:0/3501252561 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd4009590 con 0x7f1fec10f060 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1feaffd6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1fec10f060 0x7f1fec0f4800 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fe000b740 tx=0x7f1fe000bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.525+0000 7f1fcbfff6c0 1 -- 10.20.193.40:0/3501252561 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1fe0004250 con 0x7f1fec10f060 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.526+0000 7f1fcbfff6c0 1 -- 10.20.193.40:0/3501252561 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1fe0009070 con 0x7f1fec10f060 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.526+0000 7f1febfff6c0 1 -- 10.20.193.40:0/3501252561 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec0faae0 con 0x7f1fec10f060 2026-02-13T01:23:29.529 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.526+0000 7f1fcbfff6c0 1 -- 10.20.193.40:0/3501252561 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1fe00071c0 con 0x7f1fec10f060 2026-02-13T01:23:29.530 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.526+0000 7f1febfff6c0 1 -- 10.20.193.40:0/3501252561 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec0fb270 con 0x7f1fec10f060 2026-02-13T01:23:29.530 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.526+0000 7f1fc9ffb6c0 1 -- 10.20.193.40:0/3501252561 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec110330 con 0x7f1fec10f060 2026-02-13T01:23:29.530 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.528+0000 7f1fcbfff6c0 1 -- 10.20.193.40:0/3501252561 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f1fe000c560 con 0x7f1fec10f060 2026-02-13T01:23:29.531 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.530+0000 7f1fcbfff6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1fc00b5650 0x7f1fc00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:29.532 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.530+0000 7f1fcbfff6c0 1 -- 10.20.193.40:0/3501252561 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6839+0+0 (secure 0 0 0) 0x7f1fe00e3590 con 0x7f1fec10f060 2026-02-13T01:23:29.532 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.530+0000 7f1fea7fc6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1fc00b5650 0x7f1fc00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:29.532 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.530+0000 7f1fcbfff6c0 1 -- 10.20.193.40:0/3501252561 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1fe00e3a10 con 0x7f1fec10f060 2026-02-13T01:23:29.532 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.531+0000 7f1fea7fc6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1fc00b5650 0x7f1fc00d5b00 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fec0fb190 tx=0x7f1fd40023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:29.633 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.632+0000 7f1fc9ffb6c0 1 -- 10.20.193.40:0/3501252561 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1fec0f5950 con 0x7f1fec10f060 2026-02-13T01:23:29.634 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.632+0000 7f1fcbfff6c0 1 -- 10.20.193.40:0/3501252561 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f1fe00a64b0 con 0x7f1fec10f060 2026-02-13T01:23:29.634 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:29.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.634+0000 7f1fc9ffb6c0 1 -- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1fc00b5650 msgr2=0x7f1fc00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:29.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.634+0000 7f1fc9ffb6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1fc00b5650 0x7f1fc00d5b00 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fec0fb190 tx=0x7f1fd40023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.634+0000 7f1fc9ffb6c0 1 -- 10.20.193.40:0/3501252561 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1fec10f060 msgr2=0x7f1fec0f4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:29.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.634+0000 7f1fc9ffb6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1fec10f060 0x7f1fec0f4800 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fe000b740 tx=0x7f1fe000bc10 comp rx=0 tx=0).stop 2026-02-13T01:23:29.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.635+0000 7f1fc9ffb6c0 1 -- 10.20.193.40:0/3501252561 shutdown_connections 2026-02-13T01:23:29.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.635+0000 7f1fc9ffb6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1fc00b5650 0x7f1fc00d5b00 unknown :-1 s=CLOSED pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.635+0000 7f1fc9ffb6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1fec0f4e30 0x7f1fec0fa100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.635+0000 7f1fc9ffb6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1fec115270 0x7f1fec175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.635+0000 7f1fc9ffb6c0 1 --2- 10.20.193.40:0/3501252561 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1fec10f060 0x7f1fec0f4800 unknown :-1 s=CLOSED pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:29.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.635+0000 7f1fc9ffb6c0 1 -- 10.20.193.40:0/3501252561 >> 10.20.193.40:0/3501252561 conn(0x7f1fec0ec980 msgr2=0x7f1fec10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:29.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.635+0000 7f1fc9ffb6c0 1 -- 10.20.193.40:0/3501252561 shutdown_connections 2026-02-13T01:23:29.637 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:29.635+0000 7f1fc9ffb6c0 1 -- 10.20.193.40:0/3501252561 wait complete. 2026-02-13T01:23:29.743 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1770945801,"num_in_osds":12,"osd_in_since":1770945801,"num_remapped_pgs":0} 2026-02-13T01:23:30.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:30 trial055 ceph-mon[27509]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:23:30.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:30 trial055 ceph-mon[27509]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T01:23:30.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:30 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:30.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:30 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:30.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:30 trial055 ceph-mon[27509]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:30.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:30 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3501252561' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:23:30.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:30 trial040 ceph-mon[23046]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:23:30.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:30 trial040 ceph-mon[23046]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T01:23:30.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:30 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:30.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:30 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:30.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:30 trial040 ceph-mon[23046]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:30.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:30 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3501252561' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:23:30.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:30 trial118 ceph-mon[27812]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial118", "root=default"]}]': finished 2026-02-13T01:23:30.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:30 trial118 ceph-mon[27812]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T01:23:30.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:30 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:30.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:30 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:30.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:30 trial118 ceph-mon[27812]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:23:30.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:30 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3501252561' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:23:30.744 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T01:23:30.930 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:31.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.128+0000 7ff14bda76c0 1 -- 10.20.193.40:0/3750044213 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff14410f200 msgr2=0x7ff14410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.128+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/3750044213 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff14410f200 0x7ff14410f5d0 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=14006001535207151037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1340099a0 tx=0x7ff13402ed00 comp rx=0 tx=0).stop 2026-02-13T01:23:31.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.129+0000 7ff14bda76c0 1 -- 10.20.193.40:0/3750044213 shutdown_connections 2026-02-13T01:23:31.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.129+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/3750044213 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff144115410 0x7ff144175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.129+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/3750044213 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff14410fbf0 0x7ff144114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.129+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/3750044213 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff14410f200 0x7ff14410f5d0 unknown :-1 s=CLOSED pgs=149 gs=2 cs=0 l=1 c_cookie=14006001535207151037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.129+0000 7ff14bda76c0 1 -- 10.20.193.40:0/3750044213 >> 10.20.193.40:0/3750044213 conn(0x7ff1440ecb00 msgr2=0x7ff14410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:31.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.129+0000 7ff14bda76c0 1 -- 10.20.193.40:0/3750044213 shutdown_connections 2026-02-13T01:23:31.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.129+0000 7ff14bda76c0 1 -- 10.20.193.40:0/3750044213 wait complete. 2026-02-13T01:23:31.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff14bda76c0 1 Processor -- start 2026-02-13T01:23:31.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff14bda76c0 1 -- start start 2026-02-13T01:23:31.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff14bda76c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff14410f200 0x7ff14411cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:31.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff14bda76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff144115410 0x7ff14411d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:31.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff14bda76c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff1441228b0 0x7ff144122d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:31.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff14bda76c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff1441232c0 con 0x7ff144115410 2026-02-13T01:23:31.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff14bda76c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff144123430 con 0x7ff1441228b0 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff14bda76c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff1441235f0 con 0x7ff14410f200 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff149b186c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff14410f200 0x7ff14411cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff149b186c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff14410f200 0x7ff14411cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:43392/0 (socket says 10.20.193.40:43392) 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff1493176c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff144115410 0x7ff14411d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff149b186c0 1 -- 10.20.193.40:0/1642056702 learned_addr learned my addr 10.20.193.40:0/1642056702 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff14a3196c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff1441228b0 0x7ff144122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff149b186c0 1 -- 10.20.193.40:0/1642056702 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff1441228b0 msgr2=0x7ff144122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff149b186c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff1441228b0 0x7ff144122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.130+0000 7ff149b186c0 1 -- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff144115410 msgr2=0x7ff14411d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.131+0000 7ff149b186c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff144115410 0x7ff14411d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.131+0000 7ff149b186c0 1 -- 10.20.193.40:0/1642056702 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff134009590 con 0x7ff14410f200 2026-02-13T01:23:31.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.131+0000 7ff1493176c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff144115410 0x7ff14411d4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:31.135 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.131+0000 7ff149b186c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff14410f200 0x7ff14411cfb0 secure :-1 s=READY pgs=73 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff13402f210 tx=0x7ff13402f810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:31.135 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.131+0000 7ff132ffd6c0 1 -- 10.20.193.40:0/1642056702 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff134005e90 con 0x7ff14410f200 2026-02-13T01:23:31.135 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.131+0000 7ff132ffd6c0 1 -- 10.20.193.40:0/1642056702 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff1340046b0 con 0x7ff14410f200 2026-02-13T01:23:31.135 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.131+0000 7ff132ffd6c0 1 -- 10.20.193.40:0/1642056702 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1340073f0 con 0x7ff14410f200 2026-02-13T01:23:31.135 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.131+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff144163a40 con 0x7ff14410f200 2026-02-13T01:23:31.135 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.131+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff144163e70 con 0x7ff14410f200 2026-02-13T01:23:31.135 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.132+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1441104d0 con 0x7ff14410f200 2026-02-13T01:23:31.135 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.134+0000 7ff132ffd6c0 1 -- 10.20.193.40:0/1642056702 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7ff1340026b0 con 0x7ff14410f200 2026-02-13T01:23:31.136 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.135+0000 7ff132ffd6c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1200b56d0 0x7ff1200d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:31.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.135+0000 7ff132ffd6c0 1 -- 10.20.193.40:0/1642056702 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7ff134107770 con 0x7ff14410f200 2026-02-13T01:23:31.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.135+0000 7ff1493176c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1200b56d0 0x7ff1200d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:31.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.135+0000 7ff132ffd6c0 1 -- 10.20.193.40:0/1642056702 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff134107bf0 con 0x7ff14410f200 2026-02-13T01:23:31.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.136+0000 7ff1493176c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1200b56d0 0x7ff1200d5b80 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff144123940 tx=0x7ff138009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:31.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.239+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff14410f5d0 con 0x7ff14410f200 2026-02-13T01:23:31.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.239+0000 7ff132ffd6c0 1 -- 10.20.193.40:0/1642056702 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7ff1340ca580 con 0x7ff14410f200 2026-02-13T01:23:31.241 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:31.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1200b56d0 msgr2=0x7ff1200d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1200b56d0 0x7ff1200d5b80 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff144123940 tx=0x7ff138009260 comp rx=0 tx=0).stop 2026-02-13T01:23:31.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff14410f200 msgr2=0x7ff14411cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff14410f200 0x7ff14411cfb0 secure :-1 s=READY pgs=73 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff13402f210 tx=0x7ff13402f810 comp rx=0 tx=0).stop 2026-02-13T01:23:31.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 shutdown_connections 2026-02-13T01:23:31.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff1200b56d0 0x7ff1200d5b80 unknown :-1 s=CLOSED pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff1441228b0 0x7ff144122d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff144115410 0x7ff14411d4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 --2- 10.20.193.40:0/1642056702 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff14410f200 0x7ff14411cfb0 unknown :-1 s=CLOSED pgs=73 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 >> 10.20.193.40:0/1642056702 conn(0x7ff1440ecb00 msgr2=0x7ff14410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:31.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 shutdown_connections 2026-02-13T01:23:31.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.240+0000 7ff14bda76c0 1 -- 10.20.193.40:0/1642056702 wait complete. 2026-02-13T01:23:31.315 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:31 trial040 ceph-mon[23046]: purged_snaps scrub starts 2026-02-13T01:23:31.315 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:31 trial040 ceph-mon[23046]: purged_snaps scrub ok 2026-02-13T01:23:31.316 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:31.316 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:31 trial040 ceph-mon[23046]: osd.11 [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] boot 2026-02-13T01:23:31.316 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:31 trial040 ceph-mon[23046]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T01:23:31.316 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:31 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:31.344 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1770945810,"num_in_osds":12,"osd_in_since":1770945801,"num_remapped_pgs":0} 2026-02-13T01:23:31.345 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:23:31.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:31 trial055 ceph-mon[27509]: purged_snaps scrub starts 2026-02-13T01:23:31.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:31 trial055 ceph-mon[27509]: purged_snaps scrub ok 2026-02-13T01:23:31.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:31.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:31 trial055 ceph-mon[27509]: osd.11 [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] boot 2026-02-13T01:23:31.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:31 trial055 ceph-mon[27509]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T01:23:31.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:31 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:31.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:31 trial118 ceph-mon[27812]: purged_snaps scrub starts 2026-02-13T01:23:31.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:31 trial118 ceph-mon[27812]: purged_snaps scrub ok 2026-02-13T01:23:31.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:31.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:31 trial118 ceph-mon[27812]: osd.11 [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] boot 2026-02-13T01:23:31.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:31 trial118 ceph-mon[27812]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T01:23:31.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:31 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:23:31.529 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:31.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.716+0000 7fe9c19c46c0 1 -- 10.20.193.40:0/586956458 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe9bc10c2d0 msgr2=0x7fe9bc1108a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.716+0000 7fe9c19c46c0 1 --2- 10.20.193.40:0/586956458 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe9bc10c2d0 0x7fe9bc1108a0 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=7722011923791672988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9a4009970 tx=0x7fe9a402ed10 comp rx=0 tx=0).stop 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.716+0000 7fe9c19c46c0 1 -- 10.20.193.40:0/586956458 shutdown_connections 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.716+0000 7fe9c19c46c0 1 --2- 10.20.193.40:0/586956458 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe9bc110ef0 0x7fe9bc111370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.716+0000 7fe9c19c46c0 1 --2- 10.20.193.40:0/586956458 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe9bc10c2d0 0x7fe9bc1108a0 unknown :-1 s=CLOSED pgs=74 gs=2 cs=0 l=1 c_cookie=7722011923791672988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.716+0000 7fe9c19c46c0 1 --2- 10.20.193.40:0/586956458 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe9bc10b8e0 0x7fe9bc10bcb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.716+0000 7fe9c19c46c0 1 -- 10.20.193.40:0/586956458 >> 10.20.193.40:0/586956458 conn(0x7fe9bc0e9570 msgr2=0x7fe9bc109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.716+0000 7fe9c19c46c0 1 -- 10.20.193.40:0/586956458 shutdown_connections 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.716+0000 7fe9c19c46c0 1 -- 10.20.193.40:0/586956458 wait complete. 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.717+0000 7fe9c19c46c0 1 Processor -- start 2026-02-13T01:23:31.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.717+0000 7fe9c19c46c0 1 -- start start 2026-02-13T01:23:31.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.717+0000 7fe9c19c46c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe9bc10b8e0 0x7fe9bc1215b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:31.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.717+0000 7fe9c19c46c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe9bc10c2d0 0x7fe9bc121af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:31.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.717+0000 7fe9c19c46c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe9bc110ef0 0x7fe9bc126eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:31.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.717+0000 7fe9c19c46c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc127500 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.717+0000 7fe9c19c46c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc127670 con 0x7fe9bc10c2d0 2026-02-13T01:23:31.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.717+0000 7fe9c19c46c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc127830 con 0x7fe9bc110ef0 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c09c26c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe9bc10b8e0 0x7fe9bc1215b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c09c26c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe9bc10b8e0 0x7fe9bc1215b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47500/0 (socket says 10.20.193.40:47500) 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c09c26c0 1 -- 10.20.193.40:0/1890905031 learned_addr learned my addr 10.20.193.40:0/1890905031 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9b3fff6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe9bc10c2d0 0x7fe9bc121af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c11c36c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe9bc110ef0 0x7fe9bc126eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c09c26c0 1 -- 10.20.193.40:0/1890905031 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe9bc110ef0 msgr2=0x7fe9bc126eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c09c26c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe9bc110ef0 0x7fe9bc126eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c09c26c0 1 -- 10.20.193.40:0/1890905031 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe9bc10c2d0 msgr2=0x7fe9bc121af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c09c26c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe9bc10c2d0 0x7fe9bc121af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c09c26c0 1 -- 10.20.193.40:0/1890905031 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a4009590 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c09c26c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe9bc10b8e0 0x7fe9bc1215b0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9ac009490 tx=0x7fe9ac00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:31.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9b1ffb6c0 1 -- 10.20.193.40:0/1890905031 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9ac004a80 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c19c46c0 1 -- 10.20.193.40:0/1890905031 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc127b10 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9b1ffb6c0 1 -- 10.20.193.40:0/1890905031 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe9ac009030 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9b1ffb6c0 1 -- 10.20.193.40:0/1890905031 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9ac005790 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.718+0000 7fe9c19c46c0 1 -- 10.20.193.40:0/1890905031 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc1681f0 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.719+0000 7fe98b7fe6c0 1 -- 10.20.193.40:0/1890905031 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9bc05fb90 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.721+0000 7fe9b1ffb6c0 1 -- 10.20.193.40:0/1890905031 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fe9ac004d70 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.723+0000 7fe9b1ffb6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe9980b56d0 0x7fe9980d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:31.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.723+0000 7fe9b1ffb6c0 1 -- 10.20.193.40:0/1890905031 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7fe9ac0e3770 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.723+0000 7fe9b1ffb6c0 1 -- 10.20.193.40:0/1890905031 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe9ac0e3bf0 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.723+0000 7fe9b3fff6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe9980b56d0 0x7fe9980d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:31.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.723+0000 7fe9b3fff6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe9980b56d0 0x7fe9980d5b80 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9bc127f40 tx=0x7fe9a40023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:31.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.823+0000 7fe98b7fe6c0 1 -- 10.20.193.40:0/1890905031 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9bc10bcb0 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.824+0000 7fe9b1ffb6c0 1 -- 10.20.193.40:0/1890905031 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18456 (secure 0 0 0) 0x7fe9ac0a6580 con 0x7fe9bc10b8e0 2026-02-13T01:23:31.826 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:31.826 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":70,"fsid":"304b456c-087a-11f1-98ea-d404e6e7d460","created":"2026-02-13T01:20:52.557389+0000","modified":"2026-02-13T01:23:31.103231+0000","last_up_change":"2026-02-13T01:23:30.097332+0000","last_in_change":"2026-02-13T01:23:21.835674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:22:12.069221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6fb8271-19fd-4149-91ec-ed412cd5dc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6803","nonce":3956883177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6805","nonce":3956883177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6809","nonce":3956883177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6807","nonce":3956883177}]},"public_addr":"10.20.193.40:6803/3956883177","cluster_addr":"10.20.193.40:6805/3956883177","heartbeat_back_addr":"10.20.193.40:6809/3956883177","heartbeat_front_addr":"10.20.193.40:6807/3956883177","state":["exists","up"]},{"osd":1,"uuid":"3d8d3277-423d-455b-af0d-67d15aaea487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6800","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6801","nonce":3110028162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6802","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6803","nonce":3110028162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6806","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6807","nonce":3110028162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6804","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6805","nonce":3110028162}]},"public_addr":"10.20.193.55:6801/3110028162","cluster_addr":"10.20.193.55:6803/3110028162","heartbeat_back_addr":"10.20.193.55:6807/3110028162","heartbeat_front_addr":"10.20.193.55:6805/3110028162","state":["exists","up"]},{"osd":2,"uuid":"9d84270b-3934-48db-99a7-d6b8845c344d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6800","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6801","nonce":2584237293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6802","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6803","nonce":2584237293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6806","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6807","nonce":2584237293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6804","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6805","nonce":2584237293}]},"public_addr":"10.20.193.118:6801/2584237293","cluster_addr":"10.20.193.118:6803/2584237293","heartbeat_back_addr":"10.20.193.118:6807/2584237293","heartbeat_front_addr":"10.20.193.118:6805/2584237293","state":["exists","up"]},{"osd":3,"uuid":"d7a9da01-a235-4069-9e09-562abc3c2ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6811","nonce":485777007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6813","nonce":485777007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6817","nonce":485777007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6815","nonce":485777007}]},"public_addr":"10.20.193.40:6811/485777007","cluster_addr":"10.20.193.40:6813/485777007","heartbeat_back_addr":"10.20.193.40:6817/485777007","heartbeat_front_addr":"10.20.193.40:6815/485777007","state":["exists","up"]},{"osd":4,"uuid":"a3a5b0ea-f758-46ce-bd6d-afaa74db16bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6808","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6809","nonce":3166522039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6810","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6811","nonce":3166522039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6814","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6815","nonce":3166522039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6812","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6813","nonce":3166522039}]},"public_addr":"10.20.193.55:6809/3166522039","cluster_addr":"10.20.193.55:6811/3166522039","heartbeat_back_addr":"10.20.193.55:6815/3166522039","heartbeat_front_addr":"10.20.193.55:6813/3166522039","state":["exists","up"]},{"osd":5,"uuid":"785971ea-187d-4818-a068-2f11a062f7f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6808","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6809","nonce":674220568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6810","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6811","nonce":674220568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6814","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6815","nonce":674220568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6812","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6813","nonce":674220568}]},"public_addr":"10.20.193.118:6809/674220568","cluster_addr":"10.20.193.118:6811/674220568","heartbeat_back_addr":"10.20.193.118:6815/674220568","heartbeat_front_addr":"10.20.193.118:6813/674220568","state":["exists","up"]},{"osd":6,"uuid":"d852201c-70dd-4be3-af89-2a49bdf1e9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6819","nonce":3706078337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6821","nonce":3706078337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6824","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6825","nonce":3706078337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6823","nonce":3706078337}]},"public_addr":"10.20.193.40:6819/3706078337","cluster_addr":"10.20.193.40:6821/3706078337","heartbeat_back_addr":"10.20.193.40:6825/3706078337","heartbeat_front_addr":"10.20.193.40:6823/3706078337","state":["exists","up"]},{"osd":7,"uuid":"55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6816","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6817","nonce":1340798625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6818","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6819","nonce":1340798625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6822","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6823","nonce":1340798625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6820","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6821","nonce":1340798625}]},"public_addr":"10.20.193.55:6817/1340798625","cluster_addr":"10.20.193.55:6819/1340798625","heartbeat_back_addr":"10.20.193.55:6823/1340798625","heartbeat_front_addr":"10.20.193.55:6821/1340798625","state":["exists","up"]},{"osd":8,"uuid":"9a727c13-2b82-4465-9c5a-af294ba75403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6816","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6817","nonce":2741939670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6818","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6819","nonce":2741939670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6822","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6823","nonce":2741939670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6820","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6821","nonce":2741939670}]},"public_addr":"10.20.193.118:6817/2741939670","cluster_addr":"10.20.193.118:6819/2741939670","heartbeat_back_addr":"10.20.193.118:6823/2741939670","heartbeat_front_addr":"10.20.193.118:6821/2741939670","state":["exists","up"]},{"osd":9,"uuid":"2e674b08-c75c-41c1-a91b-09987dfb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6827","nonce":1636530405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6828","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6829","nonce":1636530405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6832","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6833","nonce":1636530405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6831","nonce":1636530405}]},"public_addr":"10.20.193.40:6827/1636530405","cluster_addr":"10.20.193.40:6829/1636530405","heartbeat_back_addr":"10.20.193.40:6833/1636530405","heartbeat_front_addr":"10.20.193.40:6831/1636530405","state":["exists","up"]},{"osd":10,"uuid":"c0253c41-b910-4637-aae8-5c00bc814dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6824","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6825","nonce":461194356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6826","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6827","nonce":461194356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6830","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6831","nonce":461194356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6828","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6829","nonce":461194356}]},"public_addr":"10.20.193.55:6825/461194356","cluster_addr":"10.20.193.55:6827/461194356","heartbeat_back_addr":"10.20.193.55:6831/461194356","heartbeat_front_addr":"10.20.193.55:6829/461194356","state":["exists","up"]},{"osd":11,"uuid":"de7616d6-df2d-4ade-8676-6c4e95da253c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6824","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6825","nonce":1832833901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6826","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6827","nonce":1832833901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6830","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6831","nonce":1832833901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6828","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6829","nonce":1832833901}]},"public_addr":"10.20.193.118:6825/1832833901","cluster_addr":"10.20.193.118:6827/1832833901","heartbeat_back_addr":"10.20.193.118:6831/1832833901","heartbeat_front_addr":"10.20.193.118:6829/1832833901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:21:55.803128+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:03.064285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:10.128421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:20.969922+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:28.580756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:35.696627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:46.838480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:54.619455+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:02.014372+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:12.955709+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:20.865741+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:28.300625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.40:6801/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:6800/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/743801918":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1188631814":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1549127191":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/4084024233":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/2202236316":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/3369709934":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6801/2001072148":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6800/2001072148":"2026-02-14T01:21:00.614882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:23:31.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.825+0000 7fe98b7fe6c0 1 -- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe9980b56d0 msgr2=0x7fe9980d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.825+0000 7fe98b7fe6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe9980b56d0 0x7fe9980d5b80 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9bc127f40 tx=0x7fe9a40023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.825+0000 7fe98b7fe6c0 1 -- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe9bc10b8e0 msgr2=0x7fe9bc1215b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:31.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.825+0000 7fe98b7fe6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe9bc10b8e0 0x7fe9bc1215b0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9ac009490 tx=0x7fe9ac00bca0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.826+0000 7fe98b7fe6c0 1 -- 10.20.193.40:0/1890905031 shutdown_connections 2026-02-13T01:23:31.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.826+0000 7fe98b7fe6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe9980b56d0 0x7fe9980d5b80 unknown :-1 s=CLOSED pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.826+0000 7fe98b7fe6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe9bc110ef0 0x7fe9bc126eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.826+0000 7fe98b7fe6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe9bc10c2d0 0x7fe9bc121af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.826+0000 7fe98b7fe6c0 1 --2- 10.20.193.40:0/1890905031 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe9bc10b8e0 0x7fe9bc1215b0 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:31.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.826+0000 7fe98b7fe6c0 1 -- 10.20.193.40:0/1890905031 >> 10.20.193.40:0/1890905031 conn(0x7fe9bc0e9570 msgr2=0x7fe9bc109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:31.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.826+0000 7fe98b7fe6c0 1 -- 10.20.193.40:0/1890905031 shutdown_connections 2026-02-13T01:23:31.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:31.826+0000 7fe98b7fe6c0 1 -- 10.20.193.40:0/1890905031 wait complete. 2026-02-13T01:23:31.929 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T01:22:12.069221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T01:23:31.930 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-13T01:23:32.114 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.319+0000 7f894042b6c0 1 -- 10.20.193.40:0/715225709 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8938115410 msgr2=0x7f8938175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.319+0000 7f894042b6c0 1 --2- 10.20.193.40:0/715225709 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8938115410 0x7f8938175db0 secure :-1 s=READY pgs=151 gs=2 cs=0 l=1 c_cookie=17639487016072722453 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f893400a9b0 tx=0x7f893402fd50 comp rx=0 tx=0).stop 2026-02-13T01:23:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.319+0000 7f894042b6c0 1 -- 10.20.193.40:0/715225709 shutdown_connections 2026-02-13T01:23:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.319+0000 7f894042b6c0 1 --2- 10.20.193.40:0/715225709 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8938115410 0x7f8938175db0 unknown :-1 s=CLOSED pgs=151 gs=2 cs=0 l=1 c_cookie=17639487016072722453 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.319+0000 7f894042b6c0 1 --2- 10.20.193.40:0/715225709 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f893810fbf0 0x7f8938114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.319+0000 7f894042b6c0 1 --2- 10.20.193.40:0/715225709 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f893810f200 0x7f893810f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.319+0000 7f894042b6c0 1 -- 10.20.193.40:0/715225709 >> 10.20.193.40:0/715225709 conn(0x7f89380ecb00 msgr2=0x7f893810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.319+0000 7f894042b6c0 1 -- 10.20.193.40:0/715225709 shutdown_connections 2026-02-13T01:23:32.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.319+0000 7f894042b6c0 1 -- 10.20.193.40:0/715225709 wait complete. 2026-02-13T01:23:32.323 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f894042b6c0 1 Processor -- start 2026-02-13T01:23:32.323 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f894042b6c0 1 -- start start 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f894042b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f893810f200 0x7f893811cf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f894042b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8938115410 0x7f893811d450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f894042b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8938122810 0x7f8938122cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f894042b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8938123220 con 0x7f8938122810 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f894042b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8938123390 con 0x7f893810f200 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f894042b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8938123550 con 0x7f8938115410 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f893e19c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f893810f200 0x7f893811cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f893e99d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8938122810 0x7f8938122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f893e19c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f893810f200 0x7f893811cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:49006/0 (socket says 10.20.193.40:49006) 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.320+0000 7f893e19c6c0 1 -- 10.20.193.40:0/2151518398 learned_addr learned my addr 10.20.193.40:0/2151518398 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:32.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f893d99b6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8938115410 0x7f893811d450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f893e99d6c0 1 -- 10.20.193.40:0/2151518398 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8938115410 msgr2=0x7f893811d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f893e99d6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8938115410 0x7f893811d450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f893e99d6c0 1 -- 10.20.193.40:0/2151518398 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f893810f200 msgr2=0x7f893811cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f893e99d6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f893810f200 0x7f893811cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f893e99d6c0 1 -- 10.20.193.40:0/2151518398 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8928009590 con 0x7f8938122810 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f893e19c6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f893810f200 0x7f893811cf10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f893d99b6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8938115410 0x7f893811d450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f893e99d6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8938122810 0x7f8938122cb0 secure :-1 s=READY pgs=152 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f893400a9b0 tx=0x7f8934005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f891f7fe6c0 1 -- 10.20.193.40:0/2151518398 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8934003810 con 0x7f8938122810 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f891f7fe6c0 1 -- 10.20.193.40:0/2151518398 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f89340083c0 con 0x7f8938122810 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f891f7fe6c0 1 -- 10.20.193.40:0/2151518398 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8934039380 con 0x7f8938122810 2026-02-13T01:23:32.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893400a5b0 con 0x7f8938122810 2026-02-13T01:23:32.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.321+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8938163c10 con 0x7f8938122810 2026-02-13T01:23:32.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.322+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89381104d0 con 0x7f8938122810 2026-02-13T01:23:32.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.324+0000 7f891f7fe6c0 1 -- 10.20.193.40:0/2151518398 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f8934003970 con 0x7f8938122810 2026-02-13T01:23:32.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.326+0000 7f891f7fe6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f89140b56d0 0x7f89140d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:32.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.326+0000 7f891f7fe6c0 1 -- 10.20.193.40:0/2151518398 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f8934108830 con 0x7f8938122810 2026-02-13T01:23:32.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.326+0000 7f891f7fe6c0 1 -- 10.20.193.40:0/2151518398 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8934108cb0 con 0x7f8938122810 2026-02-13T01:23:32.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.326+0000 7f893e19c6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f89140b56d0 0x7f89140d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:32.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.326+0000 7f893e19c6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f89140b56d0 0x7f89140d5b80 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8928005b40 tx=0x7f8928009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:32.404 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:32 trial118 ceph-mon[27812]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T01:23:32.405 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:32 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1642056702' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:23:32.405 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:32 trial118 ceph-mon[27812]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:32.405 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:32 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1890905031' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:23:32.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.426+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f893810fbf0 con 0x7f8938122810 2026-02-13T01:23:32.428 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:32 trial040 ceph-mon[23046]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T01:23:32.428 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:32 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1642056702' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:23:32.428 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:32 trial040 ceph-mon[23046]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:32.428 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:32 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1890905031' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:23:32.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.427+0000 7f891f7fe6c0 1 -- 10.20.193.40:0/2151518398 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f89340cb640 con 0x7f8938122810 2026-02-13T01:23:32.429 INFO:teuthology.orchestra.run.trial040.stdout:pg_num: 1 2026-02-13T01:23:32.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f89140b56d0 msgr2=0x7f89140d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f89140b56d0 0x7f89140d5b80 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8928005b40 tx=0x7f8928009310 comp rx=0 tx=0).stop 2026-02-13T01:23:32.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8938122810 msgr2=0x7f8938122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8938122810 0x7f8938122cb0 secure :-1 s=READY pgs=152 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f893400a9b0 tx=0x7f8934005570 comp rx=0 tx=0).stop 2026-02-13T01:23:32.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 shutdown_connections 2026-02-13T01:23:32.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f89140b56d0 0x7f89140d5b80 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8938122810 0x7f8938122cb0 unknown :-1 s=CLOSED pgs=152 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8938115410 0x7f893811d450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 --2- 10.20.193.40:0/2151518398 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f893810f200 0x7f893811cf10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 >> 10.20.193.40:0/2151518398 conn(0x7f89380ecb00 msgr2=0x7f893810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:32.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 shutdown_connections 2026-02-13T01:23:32.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:32.428+0000 7f894042b6c0 1 -- 10.20.193.40:0/2151518398 wait complete. 2026-02-13T01:23:32.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:32 trial055 ceph-mon[27509]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T01:23:32.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:32 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1642056702' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:23:32.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:32 trial055 ceph-mon[27509]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:32.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:32 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1890905031' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:23:32.530 INFO:tasks.cephadm:Adding mds.a on trial040 2026-02-13T01:23:32.530 INFO:tasks.cephadm:Adding mds.d on trial040 2026-02-13T01:23:32.530 INFO:tasks.cephadm:Adding mds.g on trial040 2026-02-13T01:23:32.531 INFO:tasks.cephadm:Adding mds.j on trial040 2026-02-13T01:23:32.531 INFO:tasks.cephadm:Adding mds.b on trial055 2026-02-13T01:23:32.531 INFO:tasks.cephadm:Adding mds.e on trial055 2026-02-13T01:23:32.531 INFO:tasks.cephadm:Adding mds.h on trial055 2026-02-13T01:23:32.531 INFO:tasks.cephadm:Adding mds.k on trial055 2026-02-13T01:23:32.531 INFO:tasks.cephadm:Adding mds.c on trial118 2026-02-13T01:23:32.531 INFO:tasks.cephadm:Adding mds.f on trial118 2026-02-13T01:23:32.531 INFO:tasks.cephadm:Adding mds.i on trial118 2026-02-13T01:23:32.531 INFO:tasks.cephadm:Adding mds.l on trial118 2026-02-13T01:23:32.531 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph orch apply mds all '12;trial040=a;trial040=d;trial040=g;trial040=j;trial055=b;trial055=e;trial055=h;trial055=k;trial118=c;trial118=f;trial118=i;trial118=l' 2026-02-13T01:23:32.652 INFO:teuthology.orchestra.run.trial118.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.c/config 2026-02-13T01:23:32.773 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.768+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/291186579 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff51810fbf0 msgr2=0x7ff518114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.773 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.768+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/291186579 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff51810fbf0 0x7ff518114c30 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=4170878685075265174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5000099a0 tx=0x7ff50002ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:32.773 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.768+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/291186579 shutdown_connections 2026-02-13T01:23:32.773 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.768+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/291186579 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff518115410 0x7ff518175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.773 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.768+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/291186579 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff51810fbf0 0x7ff518114c30 unknown :-1 s=CLOSED pgs=75 gs=1 cs=0 l=1 c_cookie=4170878685075265174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.773 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.768+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/291186579 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff51810f200 0x7ff51810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.768+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/291186579 >> 10.20.193.118:0/291186579 conn(0x7ff5180ecb00 msgr2=0x7ff51810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.768+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/291186579 shutdown_connections 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.768+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/291186579 wait complete. 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 Processor -- start 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 -- start start 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff51810f200 0x7ff51811cfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff518115410 0x7ff51811d4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5181228a0 0x7ff518122d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181232b0 con 0x7ff5181228a0 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff518123420 con 0x7ff51810f200 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181235e0 con 0x7ff518115410 2026-02-13T01:23:32.774 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d04b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff518115410 0x7ff51811d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d04b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff518115410 0x7ff51811d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.118:54714/0 (socket says 10.20.193.118:54714) 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d04b6c0 1 -- 10.20.193.118:0/715012966 learned_addr learned my addr 10.20.193.118:0/715012966 (peer_addr_for_me v2:10.20.193.118:0/0) 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d84c6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff51810f200 0x7ff51811cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51e04d6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5181228a0 0x7ff518122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d04b6c0 1 -- 10.20.193.118:0/715012966 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff51810f200 msgr2=0x7ff51811cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d04b6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff51810f200 0x7ff51811cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d04b6c0 1 -- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5181228a0 msgr2=0x7ff518122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d04b6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5181228a0 0x7ff518122d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d04b6c0 1 -- 10.20.193.118:0/715012966 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff500009590 con 0x7ff518115410 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51d04b6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff518115410 0x7ff51811d4e0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff50002f230 tx=0x7ff50002f830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff516ffd6c0 1 -- 10.20.193.118:0/715012966 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5000026b0 con 0x7ff518115410 2026-02-13T01:23:32.775 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff516ffd6c0 1 -- 10.20.193.118:0/715012966 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff500002d40 con 0x7ff518115410 2026-02-13T01:23:32.776 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff518163a30 con 0x7ff518115410 2026-02-13T01:23:32.776 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff516ffd6c0 1 -- 10.20.193.118:0/715012966 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff500007670 con 0x7ff518115410 2026-02-13T01:23:32.776 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.769+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff518163eb0 con 0x7ff518115410 2026-02-13T01:23:32.776 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.770+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5181104d0 con 0x7ff518115410 2026-02-13T01:23:32.777 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.771+0000 7ff516ffd6c0 1 -- 10.20.193.118:0/715012966 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7ff500002810 con 0x7ff518115410 2026-02-13T01:23:32.777 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.772+0000 7ff516ffd6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff4e00b56d0 0x7ff4e00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:32.777 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.772+0000 7ff516ffd6c0 1 -- 10.20.193.118:0/715012966 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7ff500107a30 con 0x7ff518115410 2026-02-13T01:23:32.777 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.772+0000 7ff51d84c6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff4e00b56d0 0x7ff4e00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:32.777 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.772+0000 7ff516ffd6c0 1 -- 10.20.193.118:0/715012966 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff5000ca840 con 0x7ff518115410 2026-02-13T01:23:32.777 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.773+0000 7ff51d84c6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff4e00b56d0 0x7ff4e00d5b80 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff504005980 tx=0x7ff504005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:32.872 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.870+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial040=a;trial040=d;trial040=g;trial040=j;trial055=b;trial055=e;trial055=h;trial055=k;trial118=c;trial118=f;trial118=i;trial118=l", "target": ["mon-mgr", ""]}) -- 0x7ff51811e0f0 con 0x7ff4e00b56d0 2026-02-13T01:23:32.879 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.877+0000 7ff516ffd6c0 1 -- 10.20.193.118:0/715012966 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7ff51811e0f0 con 0x7ff4e00b56d0 2026-02-13T01:23:32.879 INFO:teuthology.orchestra.run.trial118.stdout:Scheduled mds.all update... 2026-02-13T01:23:32.881 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff4e00b56d0 msgr2=0x7ff4e00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.881 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff4e00b56d0 0x7ff4e00d5b80 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff504005980 tx=0x7ff504005910 comp rx=0 tx=0).stop 2026-02-13T01:23:32.881 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff518115410 msgr2=0x7ff51811d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:32.881 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff518115410 0x7ff51811d4e0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff50002f230 tx=0x7ff50002f830 comp rx=0 tx=0).stop 2026-02-13T01:23:32.882 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 shutdown_connections 2026-02-13T01:23:32.882 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff4e00b56d0 0x7ff4e00d5b80 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.882 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5181228a0 0x7ff518122d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.882 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff518115410 0x7ff51811d4e0 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.882 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 --2- 10.20.193.118:0/715012966 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff51810f200 0x7ff51811cfa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:32.882 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 >> 10.20.193.118:0/715012966 conn(0x7ff5180ecb00 msgr2=0x7ff51810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:32.882 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.878+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 shutdown_connections 2026-02-13T01:23:32.882 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-13T01:23:32.879+0000 7ff51fadb6c0 1 -- 10.20.193.118:0/715012966 wait complete. 2026-02-13T01:23:32.920 DEBUG:teuthology.orchestra.run.trial040:mds.a> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.a.service 2026-02-13T01:23:32.924 DEBUG:teuthology.orchestra.run.trial040:mds.d> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.d.service 2026-02-13T01:23:32.970 DEBUG:teuthology.orchestra.run.trial040:mds.g> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.g.service 2026-02-13T01:23:33.014 DEBUG:teuthology.orchestra.run.trial040:mds.j> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.j.service 2026-02-13T01:23:33.058 DEBUG:teuthology.orchestra.run.trial055:mds.b> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.b.service 2026-02-13T01:23:33.062 DEBUG:teuthology.orchestra.run.trial055:mds.e> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.e.service 2026-02-13T01:23:33.104 DEBUG:teuthology.orchestra.run.trial055:mds.h> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.h.service 2026-02-13T01:23:33.147 DEBUG:teuthology.orchestra.run.trial055:mds.k> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.k.service 2026-02-13T01:23:33.190 DEBUG:teuthology.orchestra.run.trial118:mds.c> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.c.service 2026-02-13T01:23:33.192 DEBUG:teuthology.orchestra.run.trial118:mds.f> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.f.service 2026-02-13T01:23:33.194 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:33 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2151518398' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T01:23:33.194 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:33 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:33.194 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:33 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:33.194 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:33 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.194 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:33 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:33.194 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:33 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:33.194 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:33 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:33.195 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:33 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:33.195 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:33 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.196 DEBUG:teuthology.orchestra.run.trial118:mds.i> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.i.service 2026-02-13T01:23:33.238 DEBUG:teuthology.orchestra.run.trial118:mds.l> sudo journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.l.service 2026-02-13T01:23:33.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:33 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2151518398' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T01:23:33.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:33 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:33.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:33 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:33.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:33 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:33 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:33.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:33 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:33.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:33 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:33.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:33 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:33.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:33 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.282 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-13T01:23:33.282 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:23:33.465 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:33.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:33 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2151518398' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T01:23:33.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:33 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:33.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:33 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:33.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:33 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:33 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:33.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:33 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:33.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:33 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:33.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:33 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:33.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:33 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.651+0000 7f3402b346c0 1 -- 10.20.193.40:0/2365690110 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 msgr2=0x7f33fc175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.651+0000 7f3402b346c0 1 --2- 10.20.193.40:0/2365690110 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 0x7f33fc175db0 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=10303807979943896800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33f800aa70 tx=0x7f33f802fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.651+0000 7f3402b346c0 1 -- 10.20.193.40:0/2365690110 shutdown_connections 2026-02-13T01:23:33.654 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.651+0000 7f3402b346c0 1 --2- 10.20.193.40:0/2365690110 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 0x7f33fc175db0 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=10303807979943896800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.654 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.651+0000 7f3402b346c0 1 --2- 10.20.193.40:0/2365690110 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f33fc10fbf0 0x7f33fc114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.654 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.651+0000 7f3402b346c0 1 --2- 10.20.193.40:0/2365690110 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f33fc10f200 0x7f33fc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.654 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.651+0000 7f3402b346c0 1 -- 10.20.193.40:0/2365690110 >> 10.20.193.40:0/2365690110 conn(0x7f33fc0ecb00 msgr2=0x7f33fc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:33.654 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.652+0000 7f3402b346c0 1 -- 10.20.193.40:0/2365690110 shutdown_connections 2026-02-13T01:23:33.654 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.652+0000 7f3402b346c0 1 -- 10.20.193.40:0/2365690110 wait complete. 2026-02-13T01:23:33.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.652+0000 7f3402b346c0 1 Processor -- start 2026-02-13T01:23:33.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f3402b346c0 1 -- start start 2026-02-13T01:23:33.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f3402b346c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f33fc10f200 0x7f33fc11cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:33.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f3402b346c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 0x7f33fc11d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:33.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f3402b346c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f33fc122830 0x7f33fc122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:33.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f3402b346c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc123240 con 0x7f33fc115410 2026-02-13T01:23:33.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f3402b346c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc1233b0 con 0x7f33fc122830 2026-02-13T01:23:33.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f3402b346c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc123570 con 0x7f33fc10f200 2026-02-13T01:23:33.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f33f3fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 0x7f33fc11d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f33f3fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 0x7f33fc11d470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47530/0 (socket says 10.20.193.40:47530) 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f33f3fff6c0 1 -- 10.20.193.40:0/481251904 learned_addr learned my addr 10.20.193.40:0/481251904 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f34008a96c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f33fc10f200 0x7f33fc11cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f34010aa6c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f33fc122830 0x7f33fc122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f33f3fff6c0 1 -- 10.20.193.40:0/481251904 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f33fc10f200 msgr2=0x7f33fc11cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f33f3fff6c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f33fc10f200 0x7f33fc11cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f33f3fff6c0 1 -- 10.20.193.40:0/481251904 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f33fc122830 msgr2=0x7f33fc122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f33f3fff6c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f33fc122830 0x7f33fc122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.653+0000 7f33f3fff6c0 1 -- 10.20.193.40:0/481251904 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f800a660 con 0x7f33fc115410 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.654+0000 7f33f3fff6c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 0x7f33fc11d470 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33e4005fd0 tx=0x7f33e400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.654+0000 7f33f1ffb6c0 1 -- 10.20.193.40:0/481251904 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33e4004280 con 0x7f33fc115410 2026-02-13T01:23:33.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.654+0000 7f33f1ffb6c0 1 -- 10.20.193.40:0/481251904 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f33e40043e0 con 0x7f33fc115410 2026-02-13T01:23:33.658 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.654+0000 7f33f1ffb6c0 1 -- 10.20.193.40:0/481251904 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33e40072a0 con 0x7f33fc115410 2026-02-13T01:23:33.658 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.654+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc163a20 con 0x7f33fc115410 2026-02-13T01:23:33.658 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.654+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc163eb0 con 0x7f33fc115410 2026-02-13T01:23:33.658 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.655+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33fc1104d0 con 0x7f33fc115410 2026-02-13T01:23:33.658 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.657+0000 7f33f1ffb6c0 1 -- 10.20.193.40:0/481251904 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f33e400c4d0 con 0x7f33fc115410 2026-02-13T01:23:33.659 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.658+0000 7f33f1ffb6c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33d80b56d0 0x7f33d80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:33.660 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.658+0000 7f33f1ffb6c0 1 -- 10.20.193.40:0/481251904 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f33e40e36c0 con 0x7f33fc115410 2026-02-13T01:23:33.660 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.659+0000 7f34008a96c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33d80b56d0 0x7f33d80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:33.660 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.659+0000 7f33f1ffb6c0 1 -- 10.20.193.40:0/481251904 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f33e40a64d0 con 0x7f33fc115410 2026-02-13T01:23:33.660 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.659+0000 7f34008a96c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33d80b56d0 0x7f33d80d5b80 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33ec004750 tx=0x7f33ec009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:33.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.782+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33fc10f5d0 con 0x7f33fc115410 2026-02-13T01:23:33.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.782+0000 7f33f1ffb6c0 1 -- 10.20.193.40:0/481251904 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f33e40a9680 con 0x7f33fc115410 2026-02-13T01:23:33.784 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:33.785 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":1,"btime":"2026-02-13T01:20:52:557210+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-13T01:23:33.785 INFO:teuthology.orchestra.run.trial040.stderr:dumped fsmap epoch 1 2026-02-13T01:23:33.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33d80b56d0 msgr2=0x7f33d80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33d80b56d0 0x7f33d80d5b80 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33ec004750 tx=0x7f33ec009260 comp rx=0 tx=0).stop 2026-02-13T01:23:33.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 msgr2=0x7f33fc11d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 0x7f33fc11d470 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33e4005fd0 tx=0x7f33e400bca0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 shutdown_connections 2026-02-13T01:23:33.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33d80b56d0 0x7f33d80d5b80 unknown :-1 s=CLOSED pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f33fc122830 0x7f33fc122cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f33fc115410 0x7f33fc11d470 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 --2- 10.20.193.40:0/481251904 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f33fc10f200 0x7f33fc11cf30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 >> 10.20.193.40:0/481251904 conn(0x7f33fc0ecb00 msgr2=0x7f33fc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:33.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.784+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 shutdown_connections 2026-02-13T01:23:33.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:33.786+0000 7f3402b346c0 1 -- 10.20.193.40:0/481251904 wait complete. 2026-02-13T01:23:34.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:34 trial055 ceph-mon[27509]: from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial040=a;trial040=d;trial040=g;trial040=j;trial055=b;trial055=e;trial055=h;trial055=k;trial118=c;trial118=f;trial118=i;trial118=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:34.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:34 trial055 ceph-mon[27509]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:34.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:34 trial055 ceph-mon[27509]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:34.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:34.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:34.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:34 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:34 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/481251904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:34.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:34 trial040 ceph-mon[23046]: from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial040=a;trial040=d;trial040=g;trial040=j;trial055=b;trial055=e;trial055=h;trial055=k;trial118=c;trial118=f;trial118=i;trial118=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:34.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:34 trial040 ceph-mon[23046]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:34.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:34 trial040 ceph-mon[23046]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:34.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:34.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:34.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:34 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:34 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/481251904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:34.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:34 trial118 ceph-mon[27812]: from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial040=a;trial040=d;trial040=g;trial040=j;trial055=b;trial055=e;trial055=h;trial055=k;trial118=c;trial118=f;trial118=i;trial118=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:34.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:34 trial118 ceph-mon[27812]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:34.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:34 trial118 ceph-mon[27812]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:34.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:34.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:34.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:34 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:34 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/481251904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:34.504 INFO:journalctl@ceph.mds.l.trial118.stdout:Feb 13 01:23:34 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-l[57359]: starting mds.l at 2026-02-13T01:23:35.317 INFO:journalctl@ceph.mds.k.trial055.stdout:Feb 13 01:23:35 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-k[55736]: starting mds.k at 2026-02-13T01:23:35.666 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.118:6832/3201305130,v1:10.20.193.118:6833/3201305130] up:boot 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: fsmap 1 up:standby 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.667 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.668 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.668 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:35.668 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:35.668 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:35 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:35.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.118:6832/3201305130,v1:10.20.193.118:6833/3201305130] up:boot 2026-02-13T01:23:35.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: fsmap 1 up:standby 2026-02-13T01:23:35.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T01:23:35.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:35.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:35.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:35.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:35.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:35.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:35 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:35.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.118:6832/3201305130,v1:10.20.193.118:6833/3201305130] up:boot 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: fsmap 1 up:standby 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:35.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:35.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:35.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:35 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:35.893 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:23:36.164 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:36.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.414+0000 7fb8d38e46c0 1 -- 10.20.193.40:0/1289044833 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 msgr2=0x7fb8cc10be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:36.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.414+0000 7fb8d38e46c0 1 --2- 10.20.193.40:0/1289044833 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 0x7fb8cc10be50 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=13819019104548070850 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8bc009970 tx=0x7fb8bc02ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:36.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.414+0000 7fb8d38e46c0 1 -- 10.20.193.40:0/1289044833 shutdown_connections 2026-02-13T01:23:36.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.414+0000 7fb8d38e46c0 1 --2- 10.20.193.40:0/1289044833 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb8cc1557b0 0x7fb8cc175b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:36.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.414+0000 7fb8d38e46c0 1 --2- 10.20.193.40:0/1289044833 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb8cc10c390 0x7fb8cc155270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:36.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.414+0000 7fb8d38e46c0 1 --2- 10.20.193.40:0/1289044833 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 0x7fb8cc10be50 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=13819019104548070850 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:36.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.414+0000 7fb8d38e46c0 1 -- 10.20.193.40:0/1289044833 >> 10.20.193.40:0/1289044833 conn(0x7fb8cc0e9740 msgr2=0x7fb8cc109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:36.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.414+0000 7fb8d38e46c0 1 -- 10.20.193.40:0/1289044833 shutdown_connections 2026-02-13T01:23:36.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.414+0000 7fb8d38e46c0 1 -- 10.20.193.40:0/1289044833 wait complete. 2026-02-13T01:23:36.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.415+0000 7fb8d38e46c0 1 Processor -- start 2026-02-13T01:23:36.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.415+0000 7fb8d38e46c0 1 -- start start 2026-02-13T01:23:36.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.415+0000 7fb8d38e46c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 0x7fb8cc171730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:36.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.415+0000 7fb8d38e46c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb8cc10c390 0x7fb8cc171c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:36.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.415+0000 7fb8d38e46c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb8cc1557b0 0x7fb8cc0571e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:36.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d38e46c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc057830 con 0x7fb8cc10ba80 2026-02-13T01:23:36.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d16556c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 0x7fb8cc171730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d38e46c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc0579a0 con 0x7fb8cc1557b0 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d38e46c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc057b60 con 0x7fb8cc10c390 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d16556c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 0x7fb8cc171730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47546/0 (socket says 10.20.193.40:47546) 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d16556c0 1 -- 10.20.193.40:0/537233093 learned_addr learned my addr 10.20.193.40:0/537233093 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d0e546c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb8cc10c390 0x7fb8cc171c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d1e566c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb8cc1557b0 0x7fb8cc0571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d16556c0 1 -- 10.20.193.40:0/537233093 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb8cc10c390 msgr2=0x7fb8cc171c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d16556c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb8cc10c390 0x7fb8cc171c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d16556c0 1 -- 10.20.193.40:0/537233093 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb8cc1557b0 msgr2=0x7fb8cc0571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d16556c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb8cc1557b0 0x7fb8cc0571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:36.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d16556c0 1 -- 10.20.193.40:0/537233093 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc009590 con 0x7fb8cc10ba80 2026-02-13T01:23:36.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8d16556c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 0x7fb8cc171730 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8bc005ae0 tx=0x7fb8bc02f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:36.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.416+0000 7fb8ba7fc6c0 1 -- 10.20.193.40:0/537233093 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8bc0046b0 con 0x7fb8cc10ba80 2026-02-13T01:23:36.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.417+0000 7fb8ba7fc6c0 1 -- 10.20.193.40:0/537233093 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb8bc002be0 con 0x7fb8cc10ba80 2026-02-13T01:23:36.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.417+0000 7fb8d38e46c0 1 -- 10.20.193.40:0/537233093 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8cc057de0 con 0x7fb8cc10ba80 2026-02-13T01:23:36.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.417+0000 7fb8ba7fc6c0 1 -- 10.20.193.40:0/537233093 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8bc0073f0 con 0x7fb8cc10ba80 2026-02-13T01:23:36.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.417+0000 7fb8d38e46c0 1 -- 10.20.193.40:0/537233093 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8cc1523f0 con 0x7fb8cc10ba80 2026-02-13T01:23:36.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.418+0000 7fb89bfff6c0 1 -- 10.20.193.40:0/537233093 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8cc05fb30 con 0x7fb8cc10ba80 2026-02-13T01:23:36.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.420+0000 7fb8ba7fc6c0 1 -- 10.20.193.40:0/537233093 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fb8bc031250 con 0x7fb8cc10ba80 2026-02-13T01:23:36.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.421+0000 7fb8ba7fc6c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb8a80b57a0 0x7fb8a80d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:36.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.422+0000 7fb8ba7fc6c0 1 -- 10.20.193.40:0/537233093 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7fb8bc107940 con 0x7fb8cc10ba80 2026-02-13T01:23:36.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.422+0000 7fb8ba7fc6c0 1 -- 10.20.193.40:0/537233093 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb8bc107dc0 con 0x7fb8cc10ba80 2026-02-13T01:23:36.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.422+0000 7fb8d0e546c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb8a80b57a0 0x7fb8a80d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:36.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.422+0000 7fb8d0e546c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb8a80b57a0 0x7fb8a80d5c50 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8c0005fd0 tx=0x7fb8c0005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:36.473 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:36 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.55:6832/1911183527,v1:10.20.193.55:6833/1911183527] up:boot 2026-02-13T01:23:36.473 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:36 trial040 ceph-mon[23046]: fsmap 2 up:standby 2026-02-13T01:23:36.473 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T01:23:36.473 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:36 trial040 ceph-mon[23046]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:36.553 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:36.553 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":3,"btime":"2026-02-13T01:23:35:341669+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24610,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6833/3201305130","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6832","nonce":3201305130},{"type":"v1","addr":"10.20.193.118:6833","nonce":3201305130}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24632,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6833/1911183527","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6832","nonce":1911183527},{"type":"v1","addr":"10.20.193.55:6833","nonce":1911183527}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-13T01:23:36.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.551+0000 7fb89bfff6c0 1 -- 10.20.193.40:0/537233093 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8cc172880 con 0x7fb8cc10ba80 2026-02-13T01:23:36.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.551+0000 7fb8ba7fc6c0 1 -- 10.20.193.40:0/537233093 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7fb8bc0ca750 con 0x7fb8cc10ba80 2026-02-13T01:23:36.554 INFO:teuthology.orchestra.run.trial040.stderr:dumped fsmap epoch 3 2026-02-13T01:23:36.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.553+0000 7fb89bfff6c0 1 -- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb8a80b57a0 msgr2=0x7fb8a80d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:36.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.553+0000 7fb89bfff6c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb8a80b57a0 0x7fb8a80d5c50 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8c0005fd0 tx=0x7fb8c0005910 comp rx=0 tx=0).stop 2026-02-13T01:23:36.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.553+0000 7fb89bfff6c0 1 -- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 msgr2=0x7fb8cc171730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:36.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.553+0000 7fb89bfff6c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 0x7fb8cc171730 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8bc005ae0 tx=0x7fb8bc02f820 comp rx=0 tx=0).stop 2026-02-13T01:23:36.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.554+0000 7fb89bfff6c0 1 -- 10.20.193.40:0/537233093 shutdown_connections 2026-02-13T01:23:36.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.554+0000 7fb89bfff6c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb8a80b57a0 0x7fb8a80d5c50 unknown :-1 s=CLOSED pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:36.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.554+0000 7fb89bfff6c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb8cc1557b0 0x7fb8cc0571e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:36.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.554+0000 7fb89bfff6c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb8cc10c390 0x7fb8cc171c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:36.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.554+0000 7fb89bfff6c0 1 --2- 10.20.193.40:0/537233093 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb8cc10ba80 0x7fb8cc171730 unknown :-1 s=CLOSED pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:36.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.554+0000 7fb89bfff6c0 1 -- 10.20.193.40:0/537233093 >> 10.20.193.40:0/537233093 conn(0x7fb8cc0e9740 msgr2=0x7fb8cc109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:36.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.554+0000 7fb89bfff6c0 1 -- 10.20.193.40:0/537233093 shutdown_connections 2026-02-13T01:23:36.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:36.554+0000 7fb89bfff6c0 1 -- 10.20.193.40:0/537233093 wait complete. 2026-02-13T01:23:36.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:36 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.55:6832/1911183527,v1:10.20.193.55:6833/1911183527] up:boot 2026-02-13T01:23:36.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:36 trial055 ceph-mon[27509]: fsmap 2 up:standby 2026-02-13T01:23:36.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T01:23:36.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:36 trial055 ceph-mon[27509]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:36.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:36 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.55:6832/1911183527,v1:10.20.193.55:6833/1911183527] up:boot 2026-02-13T01:23:36.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:36 trial118 ceph-mon[27812]: fsmap 2 up:standby 2026-02-13T01:23:36.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T01:23:36.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:36 trial118 ceph-mon[27812]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:37.717 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:37 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/537233093' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:37.718 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:37.718 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:37.718 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:37.718 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:37.718 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:37.718 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.718 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:23:37 trial040 systemd[1]: Starting Ceph mds.d for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:23:37.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:37 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/537233093' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:37.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:37.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:37.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:37.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:37.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:37.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:37 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/537233093' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:37.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:37.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:37.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:37.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:37.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:37.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.971 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:23:37 trial040 podman[57763]: 2026-02-13 01:23:37.897418204 +0000 UTC m=+0.027365824 container create aa63d40a6bc88a6c7b7518555df0cb1bfbcd03680324992ef9bc300b2e2b9834 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-d, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, version=10, summary=Rocky Linux Base image) 2026-02-13T01:23:37.971 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:23:37 trial040 podman[57763]: 2026-02-13 01:23:37.940025806 +0000 UTC m=+0.069973426 container init aa63d40a6bc88a6c7b7518555df0cb1bfbcd03680324992ef9bc300b2e2b9834 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-d, org.opencontainers.image.title=rockylinux, name=rockylinux, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, version=10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:23:37.971 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:23:37 trial040 podman[57763]: 2026-02-13 01:23:37.945150551 +0000 UTC m=+0.075098161 container start aa63d40a6bc88a6c7b7518555df0cb1bfbcd03680324992ef9bc300b2e2b9834 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-d, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, license=BSD-3-Clause, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, OSD_FLAVOR=default, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:23:37.971 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:23:37 trial040 bash[57763]: aa63d40a6bc88a6c7b7518555df0cb1bfbcd03680324992ef9bc300b2e2b9834 2026-02-13T01:23:37.972 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:23:37 trial040 podman[57763]: 2026-02-13 01:23:37.887744174 +0000 UTC m=+0.017691804 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:23:37.972 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:23:37 trial040 systemd[1]: Started Ceph mds.d for 304b456c-087a-11f1-98ea-d404e6e7d460. 2026-02-13T01:23:37.972 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:23:37 trial040 ceph-mds[57783]: -- 10.20.193.40:0/1962761094 <== mon.0 v2:10.20.193.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e33e4d860 con 0x561e33fbfc00 2026-02-13T01:23:38.249 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:23:37 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-d[57779]: starting mds.d at 2026-02-13T01:23:38.357 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.40:6834/265154799,v1:10.20.193.40:6835/265154799] up:boot 2026-02-13T01:23:38.357 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: fsmap 3 up:standby 2026-02-13T01:23:38.357 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T01:23:38.357 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:38.682 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.40:6834/265154799,v1:10.20.193.40:6835/265154799] up:boot 2026-02-13T01:23:38.683 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: fsmap 3 up:standby 2026-02-13T01:23:38.683 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T01:23:38.683 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:38.683 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:38.683 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:38.683 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:38.683 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:38.683 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:38.683 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:38 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:38.706 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:23:38.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.40:6834/265154799,v1:10.20.193.40:6835/265154799] up:boot 2026-02-13T01:23:38.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: fsmap 3 up:standby 2026-02-13T01:23:38.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T01:23:38.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:38.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:38.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:38.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:38.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:38.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:38.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:38 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:38.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:38.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:38.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:38.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:38.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:38.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:38 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:38.897 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:38.992 INFO:journalctl@ceph.mds.e.trial055.stdout:Feb 13 01:23:38 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-e[56061]: starting mds.e at 2026-02-13T01:23:39.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.096+0000 7f23de0d86c0 1 -- 10.20.193.40:0/2404938517 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d811b510 msgr2=0x7f23d811b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:39.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.096+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/2404938517 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d811b510 0x7f23d811b8e0 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=56479642024942218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23c4009970 tx=0x7f23c402ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:39.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.096+0000 7f23de0d86c0 1 -- 10.20.193.40:0/2404938517 shutdown_connections 2026-02-13T01:23:39.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.096+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/2404938517 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f23d81149c0 0x7f23d8114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.096+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/2404938517 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f23d8113dc0 0x7f23d8114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.096+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/2404938517 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d811b510 0x7f23d811b8e0 unknown :-1 s=CLOSED pgs=160 gs=1 cs=0 l=1 c_cookie=56479642024942218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.096+0000 7f23de0d86c0 1 -- 10.20.193.40:0/2404938517 >> 10.20.193.40:0/2404938517 conn(0x7f23d8058a50 msgr2=0x7f23d8058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.097+0000 7f23de0d86c0 1 -- 10.20.193.40:0/2404938517 shutdown_connections 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.097+0000 7f23de0d86c0 1 -- 10.20.193.40:0/2404938517 wait complete. 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.097+0000 7f23de0d86c0 1 Processor -- start 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.097+0000 7f23de0d86c0 1 -- start start 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.097+0000 7f23de0d86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d8113dc0 0x7f23d812b640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.097+0000 7f23de0d86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f23d81149c0 0x7f23d812bb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.097+0000 7f23de0d86c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f23d811b510 0x7f23d8130f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:39.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23de0d86c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f23d8131590 con 0x7f23d8113dc0 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23de0d86c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f23d8131700 con 0x7f23d81149c0 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23de0d86c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f23d81318c0 con 0x7f23d811b510 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d77fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d8113dc0 0x7f23d812b640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d77fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d8113dc0 0x7f23d812b640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47614/0 (socket says 10.20.193.40:47614) 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d77fe6c0 1 -- 10.20.193.40:0/1519974193 learned_addr learned my addr 10.20.193.40:0/1519974193 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d6ffd6c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f23d81149c0 0x7f23d812bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d7fff6c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f23d811b510 0x7f23d8130f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d77fe6c0 1 -- 10.20.193.40:0/1519974193 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f23d811b510 msgr2=0x7f23d8130f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d77fe6c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f23d811b510 0x7f23d8130f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d77fe6c0 1 -- 10.20.193.40:0/1519974193 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f23d81149c0 msgr2=0x7f23d812bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d77fe6c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f23d81149c0 0x7f23d812bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d77fe6c0 1 -- 10.20.193.40:0/1519974193 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c4009590 con 0x7f23d8113dc0 2026-02-13T01:23:39.103 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d7fff6c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f23d811b510 0x7f23d8130f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:39.103 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d77fe6c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d8113dc0 0x7f23d812b640 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23c40098c0 tx=0x7f23c402f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:39.103 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d4ff96c0 1 -- 10.20.193.40:0/1519974193 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f23c40046b0 con 0x7f23d8113dc0 2026-02-13T01:23:39.103 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d8131b40 con 0x7f23d8113dc0 2026-02-13T01:23:39.103 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d4ff96c0 1 -- 10.20.193.40:0/1519974193 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f23c4031560 con 0x7f23d8113dc0 2026-02-13T01:23:39.103 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23d4ff96c0 1 -- 10.20.193.40:0/1519974193 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f23c4007d60 con 0x7f23d8113dc0 2026-02-13T01:23:39.103 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.098+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d8172280 con 0x7f23d8113dc0 2026-02-13T01:23:39.103 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.099+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d805b000 con 0x7f23d8113dc0 2026-02-13T01:23:39.104 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.101+0000 7f23d4ff96c0 1 -- 10.20.193.40:0/1519974193 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f23c40316d0 con 0x7f23d8113dc0 2026-02-13T01:23:39.104 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.103+0000 7f23d4ff96c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f23ac0b56d0 0x7f23ac0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:39.105 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.103+0000 7f23d4ff96c0 1 -- 10.20.193.40:0/1519974193 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f23c4107900 con 0x7f23d8113dc0 2026-02-13T01:23:39.105 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.103+0000 7f23d4ff96c0 1 -- 10.20.193.40:0/1519974193 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f23c4107d80 con 0x7f23d8113dc0 2026-02-13T01:23:39.105 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.103+0000 7f23d6ffd6c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f23ac0b56d0 0x7f23ac0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:39.105 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.104+0000 7f23d6ffd6c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f23ac0b56d0 0x7f23ac0d5b80 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d8131fd0 tx=0x7f23c8009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:39.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.228+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23d812c790 con 0x7f23d8113dc0 2026-02-13T01:23:39.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.228+0000 7f23d4ff96c0 1 -- 10.20.193.40:0/1519974193 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f23c40ca710 con 0x7f23d8113dc0 2026-02-13T01:23:39.230 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:39.230 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":5,"btime":"2026-02-13T01:23:38:351725+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6835/265154799","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6834","nonce":265154799},{"type":"v1","addr":"10.20.193.40:6835","nonce":265154799}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14625,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6837/3247182877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6836","nonce":3247182877},{"type":"v1","addr":"10.20.193.40:6837","nonce":3247182877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24610,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6833/3201305130","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6832","nonce":3201305130},{"type":"v1","addr":"10.20.193.118:6833","nonce":3201305130}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24632,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6833/1911183527","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6832","nonce":1911183527},{"type":"v1","addr":"10.20.193.55:6833","nonce":1911183527}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-13T01:23:39.231 INFO:teuthology.orchestra.run.trial040.stderr:dumped fsmap epoch 5 2026-02-13T01:23:39.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.229+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f23ac0b56d0 msgr2=0x7f23ac0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:39.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.229+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f23ac0b56d0 0x7f23ac0d5b80 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d8131fd0 tx=0x7f23c8009260 comp rx=0 tx=0).stop 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.229+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d8113dc0 msgr2=0x7f23d812b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.229+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d8113dc0 0x7f23d812b640 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23c40098c0 tx=0x7f23c402f8a0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.230+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 shutdown_connections 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.230+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f23ac0b56d0 0x7f23ac0d5b80 unknown :-1 s=CLOSED pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.230+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f23d811b510 0x7f23d8130f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.230+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f23d81149c0 0x7f23d812bb80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.230+0000 7f23de0d86c0 1 --2- 10.20.193.40:0/1519974193 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f23d8113dc0 0x7f23d812b640 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.230+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 >> 10.20.193.40:0/1519974193 conn(0x7f23d8058a50 msgr2=0x7f23d8118190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.230+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 shutdown_connections 2026-02-13T01:23:39.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:39.230+0000 7f23de0d86c0 1 -- 10.20.193.40:0/1519974193 wait complete. 2026-02-13T01:23:39.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.40:6836/3247182877,v1:10.20.193.40:6837/3247182877] up:boot 2026-02-13T01:23:39.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: fsmap 4 up:standby 2026-02-13T01:23:39.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T01:23:39.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:39.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:39.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:39.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:39.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:39.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:39.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:39 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1519974193' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:39.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.40:6836/3247182877,v1:10.20.193.40:6837/3247182877] up:boot 2026-02-13T01:23:39.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: fsmap 4 up:standby 2026-02-13T01:23:39.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T01:23:39.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:39.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:39.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:39.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:39.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:39.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:39.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:39 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1519974193' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.40:6836/3247182877,v1:10.20.193.40:6837/3247182877] up:boot 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: fsmap 4 up:standby 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:39.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:39 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1519974193' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:40.004 INFO:journalctl@ceph.mds.f.trial118.stdout:Feb 13 01:23:39 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-f[57687]: starting mds.f at 2026-02-13T01:23:40.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.55:6834/155719398,v1:10.20.193.55:6835/155719398] up:boot 2026-02-13T01:23:40.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: fsmap 5 up:standby 2026-02-13T01:23:40.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T01:23:40.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:40.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:40.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:40.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:40.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:40.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:40.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:40 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:40.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.55:6834/155719398,v1:10.20.193.55:6835/155719398] up:boot 2026-02-13T01:23:40.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: fsmap 5 up:standby 2026-02-13T01:23:40.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T01:23:40.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:40.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:40.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:40.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:40.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:40.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:40.750 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:40 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.55:6834/155719398,v1:10.20.193.55:6835/155719398] up:boot 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: fsmap 5 up:standby 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:40.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:40.755 INFO:journalctl@ceph.mds.c.trial118.stdout:Feb 13 01:23:40 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-c[58007]: starting mds.c at 2026-02-13T01:23:41.334 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:23:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:41 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.118:6834/3508006300,v1:10.20.193.118:6835/3508006300] up:boot 2026-02-13T01:23:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:41 trial055 ceph-mon[27509]: fsmap 6 up:standby 2026-02-13T01:23:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T01:23:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:41.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:41.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:41.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:41.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:41 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.493 INFO:journalctl@ceph.mds.h.trial055.stdout:Feb 13 01:23:41 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-h[56386]: starting mds.h at 2026-02-13T01:23:41.522 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:41.621 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:41 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.118:6834/3508006300,v1:10.20.193.118:6835/3508006300] up:boot 2026-02-13T01:23:41.621 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:41 trial040 ceph-mon[23046]: fsmap 6 up:standby 2026-02-13T01:23:41.621 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T01:23:41.621 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:41.621 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:41.622 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:41.622 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:41.622 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:41.622 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:41 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.705+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/66654439 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 msgr2=0x7f5cf4175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:41.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.705+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/66654439 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 0x7f5cf4175c10 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=17998047669807999666 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ce400aa70 tx=0x7f5ce402fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.707+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/66654439 shutdown_connections 2026-02-13T01:23:41.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.707+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/66654439 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 0x7f5cf4175c10 unknown :-1 s=CLOSED pgs=162 gs=1 cs=0 l=1 c_cookie=17998047669807999666 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.707+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/66654439 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5cf410fa50 0x7f5cf4114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.707+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/66654439 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5cf410f060 0x7f5cf410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.709 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.707+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/66654439 >> 10.20.193.40:0/66654439 conn(0x7f5cf40ec980 msgr2=0x7f5cf410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:41.709 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.707+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/66654439 shutdown_connections 2026-02-13T01:23:41.709 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.707+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/66654439 wait complete. 2026-02-13T01:23:41.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf3fff6c0 1 Processor -- start 2026-02-13T01:23:41.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf3fff6c0 1 -- start start 2026-02-13T01:23:41.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf3fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5cf410f060 0x7f5cf411cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:41.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf3fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 0x7f5cf411d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:41.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf3fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5cf4122690 0x7f5cf4122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:41.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf3fff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41230a0 con 0x7f5cf4115270 2026-02-13T01:23:41.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf3fff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4123210 con 0x7f5cf4122690 2026-02-13T01:23:41.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf3fff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41233d0 con 0x7f5cf410f060 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf27fc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 0x7f5cf411d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf27fc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 0x7f5cf411d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55176/0 (socket says 10.20.193.40:55176) 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf27fc6c0 1 -- 10.20.193.40:0/4012673330 learned_addr learned my addr 10.20.193.40:0/4012673330 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf2ffd6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5cf410f060 0x7f5cf411cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf37fe6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5cf4122690 0x7f5cf4122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf27fc6c0 1 -- 10.20.193.40:0/4012673330 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5cf410f060 msgr2=0x7f5cf411cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf27fc6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5cf410f060 0x7f5cf411cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf27fc6c0 1 -- 10.20.193.40:0/4012673330 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5cf4122690 msgr2=0x7f5cf4122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf27fc6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5cf4122690 0x7f5cf4122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.708+0000 7f5cf27fc6c0 1 -- 10.20.193.40:0/4012673330 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce400a660 con 0x7f5cf4115270 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.709+0000 7f5cf27fc6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 0x7f5cf411d2d0 secure :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cdc00b6c0 tx=0x7f5cdc00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:41.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.709+0000 7f5cd3fff6c0 1 -- 10.20.193.40:0/4012673330 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cdc004250 con 0x7f5cf4115270 2026-02-13T01:23:41.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.709+0000 7f5cd3fff6c0 1 -- 10.20.193.40:0/4012673330 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5cdc009070 con 0x7f5cf4115270 2026-02-13T01:23:41.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.709+0000 7f5cd3fff6c0 1 -- 10.20.193.40:0/4012673330 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cdc0071c0 con 0x7f5cf4115270 2026-02-13T01:23:41.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.709+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf4163880 con 0x7f5cf4115270 2026-02-13T01:23:41.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.709+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf4163d10 con 0x7f5cf4115270 2026-02-13T01:23:41.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.709+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf4110330 con 0x7f5cf4115270 2026-02-13T01:23:41.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.712+0000 7f5cd3fff6c0 1 -- 10.20.193.40:0/4012673330 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f5cdc0043b0 con 0x7f5cf4115270 2026-02-13T01:23:41.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.713+0000 7f5cd3fff6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5cc80b56d0 0x7f5cc80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:41.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.713+0000 7f5cd3fff6c0 1 -- 10.20.193.40:0/4012673330 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f5cdc0e3770 con 0x7f5cf4115270 2026-02-13T01:23:41.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.713+0000 7f5cf2ffd6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5cc80b56d0 0x7f5cc80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:41.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.713+0000 7f5cd3fff6c0 1 -- 10.20.193.40:0/4012673330 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5cdc0e3c60 con 0x7f5cf4115270 2026-02-13T01:23:41.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.714+0000 7f5cf2ffd6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5cc80b56d0 0x7f5cc80d5b80 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ce8004750 tx=0x7f5ce8009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:41.732 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:41 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.118:6834/3508006300,v1:10.20.193.118:6835/3508006300] up:boot 2026-02-13T01:23:41.732 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:41 trial118 ceph-mon[27812]: fsmap 6 up:standby 2026-02-13T01:23:41.733 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T01:23:41.733 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:41.733 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:41.733 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:41.733 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:41.733 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:41.733 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:41 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.838+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cf410f430 con 0x7f5cf4115270 2026-02-13T01:23:41.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.838+0000 7f5cd3fff6c0 1 -- 10.20.193.40:0/4012673330 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f5cdc0a65c0 con 0x7f5cf4115270 2026-02-13T01:23:41.840 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:41.840 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":8,"btime":"2026-02-13T01:23:41:362911+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6835/265154799","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6834","nonce":265154799},{"type":"v1","addr":"10.20.193.40:6835","nonce":265154799}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14625,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6837/3247182877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6836","nonce":3247182877},{"type":"v1","addr":"10.20.193.40:6837","nonce":3247182877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24610,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6833/3201305130","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6832","nonce":3201305130},{"type":"v1","addr":"10.20.193.118:6833","nonce":3201305130}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24632,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6833/1911183527","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6832","nonce":1911183527},{"type":"v1","addr":"10.20.193.55:6833","nonce":1911183527}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6835/3508006300","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6834","nonce":3508006300},{"type":"v1","addr":"10.20.193.118:6835","nonce":3508006300}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6837/3471585859","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6836","nonce":3471585859},{"type":"v1","addr":"10.20.193.118:6837","nonce":3471585859}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6835/155719398","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6834","nonce":155719398},{"type":"v1","addr":"10.20.193.55:6835","nonce":155719398}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2026-02-13T01:23:41.841 INFO:teuthology.orchestra.run.trial040.stderr:dumped fsmap epoch 8 2026-02-13T01:23:41.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5cc80b56d0 msgr2=0x7f5cc80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:41.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5cc80b56d0 0x7f5cc80d5b80 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ce8004750 tx=0x7f5ce8009260 comp rx=0 tx=0).stop 2026-02-13T01:23:41.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 msgr2=0x7f5cf411d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:41.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 0x7f5cf411d2d0 secure :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cdc00b6c0 tx=0x7f5cdc00bb90 comp rx=0 tx=0).stop 2026-02-13T01:23:41.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 shutdown_connections 2026-02-13T01:23:41.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5cc80b56d0 0x7f5cc80d5b80 unknown :-1 s=CLOSED pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5cf4122690 0x7f5cf4122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5cf4115270 0x7f5cf411d2d0 unknown :-1 s=CLOSED pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 --2- 10.20.193.40:0/4012673330 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5cf410f060 0x7f5cf411cd90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 >> 10.20.193.40:0/4012673330 conn(0x7f5cf40ec980 msgr2=0x7f5cf410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:41.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 shutdown_connections 2026-02-13T01:23:41.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:41.839+0000 7f5cf3fff6c0 1 -- 10.20.193.40:0/4012673330 wait complete. 2026-02-13T01:23:42.369 INFO:journalctl@ceph.mds.i.trial118.stdout:Feb 13 01:23:42 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-i[58330]: starting mds.i at 2026-02-13T01:23:42.736 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.118:6836/3471585859,v1:10.20.193.118:6837/3471585859] up:boot 2026-02-13T01:23:42.737 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: fsmap 7 up:standby 2026-02-13T01:23:42.737 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T01:23:42.737 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.737 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.737 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.737 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:42.737 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:42.737 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.737 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:42.738 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4012673330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:42.738 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.738 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.738 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.738 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:42.738 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:42.738 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:42 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.118:6836/3471585859,v1:10.20.193.118:6837/3471585859] up:boot 2026-02-13T01:23:42.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: fsmap 7 up:standby 2026-02-13T01:23:42.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T01:23:42.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:42.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:42.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:42.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4012673330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:42.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:42.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:42.743 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:42 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.118:6836/3471585859,v1:10.20.193.118:6837/3471585859] up:boot 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: fsmap 7 up:standby 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4012673330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:42.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:42.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:42.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:42.755 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:42 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:43.375 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:23:43 trial040 systemd[1]: Starting Ceph mds.g for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:23:43.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:43 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.55:6836/3322353780,v1:10.20.193.55:6837/3322353780] up:boot 2026-02-13T01:23:43.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:43 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.118:6838/154749702,v1:10.20.193.118:6839/154749702] up:boot 2026-02-13T01:23:43.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:43 trial055 ceph-mon[27509]: fsmap 9 up:standby 2026-02-13T01:23:43.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T01:23:43.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:43 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T01:23:43.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:43 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.55:6836/3322353780,v1:10.20.193.55:6837/3322353780] up:boot 2026-02-13T01:23:43.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:43 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.118:6838/154749702,v1:10.20.193.118:6839/154749702] up:boot 2026-02-13T01:23:43.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:43 trial040 ceph-mon[23046]: fsmap 9 up:standby 2026-02-13T01:23:43.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T01:23:43.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:43 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T01:23:43.750 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:23:43 trial040 podman[58225]: 2026-02-13 01:23:43.508187275 +0000 UTC m=+0.027592743 container create b77cb88a5688619ff7b040f88f0ea6a5570e0b9f093ec087b73d2397af0b565e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-g, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7) 2026-02-13T01:23:43.750 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:23:43 trial040 podman[58225]: 2026-02-13 01:23:43.546491529 +0000 UTC m=+0.065897017 container init b77cb88a5688619ff7b040f88f0ea6a5570e0b9f093ec087b73d2397af0b565e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-g, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10) 2026-02-13T01:23:43.750 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:23:43 trial040 podman[58225]: 2026-02-13 01:23:43.551639128 +0000 UTC m=+0.071044607 container start b77cb88a5688619ff7b040f88f0ea6a5570e0b9f093ec087b73d2397af0b565e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-g, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, OSD_FLAVOR=default, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, ceph=True, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:23:43.750 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:23:43 trial040 bash[58225]: b77cb88a5688619ff7b040f88f0ea6a5570e0b9f093ec087b73d2397af0b565e 2026-02-13T01:23:43.750 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:23:43 trial040 podman[58225]: 2026-02-13 01:23:43.498634578 +0000 UTC m=+0.018040066 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:23:43.750 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:23:43 trial040 systemd[1]: Started Ceph mds.g for 304b456c-087a-11f1-98ea-d404e6e7d460. 2026-02-13T01:23:43.750 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:23:43 trial040 ceph-mds[58245]: -- 10.20.193.40:0/943074720 <== mon.0 v2:10.20.193.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560975b35860 con 0x560975ca7c00 2026-02-13T01:23:43.751 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:23:43 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-g[58241]: starting mds.g at 2026-02-13T01:23:43.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:43 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.55:6836/3322353780,v1:10.20.193.55:6837/3322353780] up:boot 2026-02-13T01:23:43.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:43 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.118:6838/154749702,v1:10.20.193.118:6839/154749702] up:boot 2026-02-13T01:23:43.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:43 trial118 ceph-mon[27812]: fsmap 9 up:standby 2026-02-13T01:23:43.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T01:23:43.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:43 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T01:23:43.944 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:23:44.138 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:44.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.318+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/3799644301 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6e6c15e1b0 msgr2=0x7f6e6c17e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:44.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.318+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/3799644301 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6e6c15e1b0 0x7f6e6c17e590 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=4321463285174245778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e5c00aa40 tx=0x7f6e5c02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.319+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/3799644301 shutdown_connections 2026-02-13T01:23:44.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.319+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/3799644301 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6e6c15e1b0 0x7f6e6c17e590 unknown :-1 s=CLOSED pgs=166 gs=1 cs=0 l=1 c_cookie=4321463285174245778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.319+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/3799644301 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6e6c114d90 0x7f6e6c15dc70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.319+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/3799644301 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6e6c114480 0x7f6e6c114850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.319+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/3799644301 >> 10.20.193.40:0/3799644301 conn(0x7f6e6c05cef0 msgr2=0x7f6e6c05d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:44.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.319+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/3799644301 shutdown_connections 2026-02-13T01:23:44.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.319+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/3799644301 wait complete. 2026-02-13T01:23:44.323 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.319+0000 7f6e7188b6c0 1 Processor -- start 2026-02-13T01:23:44.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e7188b6c0 1 -- start start 2026-02-13T01:23:44.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e7188b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6e6c114480 0x7f6e6c0fdf70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:44.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e7188b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6e6c114d90 0x7f6e6c0fe4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:44.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e7188b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6e6c15e1b0 0x7f6e6c103870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:44.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e7188b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c103ec0 con 0x7f6e6c114d90 2026-02-13T01:23:44.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e7188b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c104030 con 0x7f6e6c114480 2026-02-13T01:23:44.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e7188b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c1041f0 con 0x7f6e6c15e1b0 2026-02-13T01:23:44.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e6affd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6e6c114480 0x7f6e6c0fdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:44.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e6affd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6e6c114480 0x7f6e6c0fdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:47640/0 (socket says 10.20.193.40:47640) 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e6affd6c0 1 -- 10.20.193.40:0/560934600 learned_addr learned my addr 10.20.193.40:0/560934600 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e6b7fe6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6e6c15e1b0 0x7f6e6c103870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e6a7fc6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6e6c114d90 0x7f6e6c0fe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e6affd6c0 1 -- 10.20.193.40:0/560934600 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6e6c15e1b0 msgr2=0x7f6e6c103870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.320+0000 7f6e6affd6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6e6c15e1b0 0x7f6e6c103870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e6affd6c0 1 -- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6e6c114d90 msgr2=0x7f6e6c0fe4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e6affd6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6e6c114d90 0x7f6e6c0fe4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e6affd6c0 1 -- 10.20.193.40:0/560934600 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c00a660 con 0x7f6e6c114480 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e6a7fc6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6e6c114d90 0x7f6e6c0fe4b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e6affd6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6e6c114480 0x7f6e6c0fdf70 secure :-1 s=READY pgs=75 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e60009490 tx=0x7f6e6000bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:44.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e708856c0 1 -- 10.20.193.40:0/560934600 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e60004a80 con 0x7f6e6c114480 2026-02-13T01:23:44.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e708856c0 1 -- 10.20.193.40:0/560934600 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6e60009030 con 0x7f6e6c114480 2026-02-13T01:23:44.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e708856c0 1 -- 10.20.193.40:0/560934600 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e60007bd0 con 0x7f6e6c114480 2026-02-13T01:23:44.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6c1044d0 con 0x7f6e6c114480 2026-02-13T01:23:44.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.321+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6c15adf0 con 0x7f6e6c114480 2026-02-13T01:23:44.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.322+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6c1046f0 con 0x7f6e6c114480 2026-02-13T01:23:44.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.324+0000 7f6e708856c0 1 -- 10.20.193.40:0/560934600 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f6e60004060 con 0x7f6e6c114480 2026-02-13T01:23:44.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.326+0000 7f6e708856c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6e400b56d0 0x7f6e400d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:44.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.326+0000 7f6e708856c0 1 -- 10.20.193.40:0/560934600 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f6e600ebfe0 con 0x7f6e6c114480 2026-02-13T01:23:44.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.326+0000 7f6e708856c0 1 -- 10.20.193.40:0/560934600 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6e600ec490 con 0x7f6e6c114480 2026-02-13T01:23:44.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.326+0000 7f6e6a7fc6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6e400b56d0 0x7f6e400d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:44.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.326+0000 7f6e6a7fc6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6e400b56d0 0x7f6e400d5b80 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e6c104900 tx=0x7f6e54009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:44.455 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.453+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e6c057030 con 0x7f6e6c114480 2026-02-13T01:23:44.455 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.453+0000 7f6e708856c0 1 -- 10.20.193.40:0/560934600 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8862 (secure 0 0 0) 0x7f6e600aee10 con 0x7f6e6c114480 2026-02-13T01:23:44.456 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:44.456 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":10,"btime":"2026-02-13T01:23:44:376203+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6835/265154799","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6834","nonce":265154799},{"type":"v1","addr":"10.20.193.40:6835","nonce":265154799}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14625,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6837/3247182877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6836","nonce":3247182877},{"type":"v1","addr":"10.20.193.40:6837","nonce":3247182877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6839/747178723","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6838","nonce":747178723},{"type":"v1","addr":"10.20.193.40:6839","nonce":747178723}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24610,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6833/3201305130","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6832","nonce":3201305130},{"type":"v1","addr":"10.20.193.118:6833","nonce":3201305130}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24632,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6833/1911183527","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6832","nonce":1911183527},{"type":"v1","addr":"10.20.193.55:6833","nonce":1911183527}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6835/3508006300","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6834","nonce":3508006300},{"type":"v1","addr":"10.20.193.118:6835","nonce":3508006300}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6837/3471585859","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6836","nonce":3471585859},{"type":"v1","addr":"10.20.193.118:6837","nonce":3471585859}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6835/155719398","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6834","nonce":155719398},{"type":"v1","addr":"10.20.193.55:6835","nonce":155719398}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24661,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6839/154749702","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6838","nonce":154749702},{"type":"v1","addr":"10.20.193.118:6839","nonce":154749702}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24671,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6837/3322353780","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6836","nonce":3322353780},{"type":"v1","addr":"10.20.193.55:6837","nonce":3322353780}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2026-02-13T01:23:44.457 INFO:teuthology.orchestra.run.trial040.stderr:dumped fsmap epoch 10 2026-02-13T01:23:44.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6e400b56d0 msgr2=0x7f6e400d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:44.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6e400b56d0 0x7f6e400d5b80 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e6c104900 tx=0x7f6e54009390 comp rx=0 tx=0).stop 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6e6c114480 msgr2=0x7f6e6c0fdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6e6c114480 0x7f6e6c0fdf70 secure :-1 s=READY pgs=75 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e60009490 tx=0x7f6e6000bca0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 shutdown_connections 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6e400b56d0 0x7f6e400d5b80 unknown :-1 s=CLOSED pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6e6c15e1b0 0x7f6e6c103870 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6e6c114d90 0x7f6e6c0fe4b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 --2- 10.20.193.40:0/560934600 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6e6c114480 0x7f6e6c0fdf70 unknown :-1 s=CLOSED pgs=75 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 >> 10.20.193.40:0/560934600 conn(0x7f6e6c05cef0 msgr2=0x7f6e6c0f4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 shutdown_connections 2026-02-13T01:23:44.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:44.455+0000 7f6e7188b6c0 1 -- 10.20.193.40:0/560934600 wait complete. 2026-02-13T01:23:44.784 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:44.785 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:44.785 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:44.785 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:44.785 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:44.785 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:44.785 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:44.785 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.40:6838/747178723,v1:10.20.193.40:6839/747178723] up:boot 2026-02-13T01:23:44.785 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: fsmap 10 up:standby 2026-02-13T01:23:44.786 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T01:23:44.786 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:44 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/560934600' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:44.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:44.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:44.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:44.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:44.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:44.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:44.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:44.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.40:6838/747178723,v1:10.20.193.40:6839/747178723] up:boot 2026-02-13T01:23:44.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: fsmap 10 up:standby 2026-02-13T01:23:44.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T01:23:44.993 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:44 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/560934600' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:45.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.40:6838/747178723,v1:10.20.193.40:6839/747178723] up:boot 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: fsmap 10 up:standby 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T01:23:45.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:44 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/560934600' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:45.249 INFO:journalctl@ceph.mds.a.trial040.stdout:Feb 13 01:23:45 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-a[58615]: starting mds.a at 2026-02-13T01:23:45.992 INFO:journalctl@ceph.mds.b.trial055.stdout:Feb 13 01:23:45 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-b[56711]: starting mds.b at 2026-02-13T01:23:46.313 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.313 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.313 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.313 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:46.313 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:46.313 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:46.313 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:46.313 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.40:6840/800475237,v1:10.20.193.40:6841/800475237] up:boot 2026-02-13T01:23:46.314 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: fsmap 11 up:standby 2026-02-13T01:23:46.314 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T01:23:46.314 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.314 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.314 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.314 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.314 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.314 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:46 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:46.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.40:6840/800475237,v1:10.20.193.40:6841/800475237] up:boot 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: fsmap 11 up:standby 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.317 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:46 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:46.481 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.481 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.481 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.481 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:23:46.481 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:23:46.481 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:46.481 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:46.481 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.40:6840/800475237,v1:10.20.193.40:6841/800475237] up:boot 2026-02-13T01:23:46.482 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: fsmap 11 up:standby 2026-02-13T01:23:46.482 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T01:23:46.482 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.482 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.482 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.482 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.482 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:46.482 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:46 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:46.612 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:23:46.800 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:47.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.010+0000 7f207c81b6c0 1 -- 10.20.193.40:0/405681920 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2074115410 msgr2=0x7f2074175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.010+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/405681920 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2074115410 0x7f2074175db0 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=10442159101044055445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f206800aa70 tx=0x7f206802fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.010+0000 7f207c81b6c0 1 -- 10.20.193.40:0/405681920 shutdown_connections 2026-02-13T01:23:47.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.010+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/405681920 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2074115410 0x7f2074175db0 unknown :-1 s=CLOSED pgs=169 gs=1 cs=0 l=1 c_cookie=10442159101044055445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.010+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/405681920 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f207410fbf0 0x7f2074114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.010+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/405681920 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f207410f200 0x7f207410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.010+0000 7f207c81b6c0 1 -- 10.20.193.40:0/405681920 >> 10.20.193.40:0/405681920 conn(0x7f20740ecb00 msgr2=0x7f207410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:47.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.010+0000 7f207c81b6c0 1 -- 10.20.193.40:0/405681920 shutdown_connections 2026-02-13T01:23:47.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.010+0000 7f207c81b6c0 1 -- 10.20.193.40:0/405681920 wait complete. 2026-02-13T01:23:47.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.011+0000 7f207c81b6c0 1 Processor -- start 2026-02-13T01:23:47.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.011+0000 7f207c81b6c0 1 -- start start 2026-02-13T01:23:47.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.011+0000 7f207c81b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f207410f200 0x7f2074102df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.011+0000 7f207c81b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2074115410 0x7f2074175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.011+0000 7f207c81b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2074103420 0x7f207405d9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.011+0000 7f207c81b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f207405df20 con 0x7f207410f200 2026-02-13T01:23:47.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.011+0000 7f207c81b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f207405e090 con 0x7f2074115410 2026-02-13T01:23:47.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.011+0000 7f207c81b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f207405e250 con 0x7f2074103420 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207a58c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f207410f200 0x7f2074102df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207a58c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f207410f200 0x7f2074102df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55244/0 (socket says 10.20.193.40:55244) 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207a58c6c0 1 -- 10.20.193.40:0/2345638595 learned_addr learned my addr 10.20.193.40:0/2345638595 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207ad8d6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2074103420 0x7f207405d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f2079d8b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2074115410 0x7f2074175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207a58c6c0 1 -- 10.20.193.40:0/2345638595 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2074103420 msgr2=0x7f207405d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207a58c6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2074103420 0x7f207405d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207a58c6c0 1 -- 10.20.193.40:0/2345638595 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2074115410 msgr2=0x7f2074175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207a58c6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2074115410 0x7f2074175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207a58c6c0 1 -- 10.20.193.40:0/2345638595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206800a660 con 0x7f207410f200 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f2079d8b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2074115410 0x7f2074175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:47.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207a58c6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f207410f200 0x7f2074102df0 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f206c00b710 tx=0x7f206c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:47.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f205f7fe6c0 1 -- 10.20.193.40:0/2345638595 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f206c004250 con 0x7f207410f200 2026-02-13T01:23:47.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f207405e4d0 con 0x7f207410f200 2026-02-13T01:23:47.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f205f7fe6c0 1 -- 10.20.193.40:0/2345638595 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f206c009070 con 0x7f207410f200 2026-02-13T01:23:47.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207410c7e0 con 0x7f207410f200 2026-02-13T01:23:47.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.012+0000 7f205f7fe6c0 1 -- 10.20.193.40:0/2345638595 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f206c004250 con 0x7f207410f200 2026-02-13T01:23:47.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.013+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f207405e850 con 0x7f207410f200 2026-02-13T01:23:47.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.015+0000 7f205f7fe6c0 1 -- 10.20.193.40:0/2345638595 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f206c00ccf0 con 0x7f207410f200 2026-02-13T01:23:47.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.017+0000 7f205f7fe6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f20500b56b0 0x7f20500d5b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.017+0000 7f205f7fe6c0 1 -- 10.20.193.40:0/2345638595 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f206c0e3350 con 0x7f207410f200 2026-02-13T01:23:47.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.017+0000 7f205f7fe6c0 1 -- 10.20.193.40:0/2345638595 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f206c0e3840 con 0x7f207410f200 2026-02-13T01:23:47.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.017+0000 7f2079d8b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f20500b56b0 0x7f20500d5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.017+0000 7f2079d8b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f20500b56b0 0x7f20500d5b60 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2074113d10 tx=0x7f2060009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:47.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.155+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f207410f630 con 0x7f207410f200 2026-02-13T01:23:47.157 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.157 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:47 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.55:6838/316274596,v1:10.20.193.55:6839/316274596] up:boot 2026-02-13T01:23:47.157 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:47 trial040 ceph-mon[23046]: fsmap 12 up:standby 2026-02-13T01:23:47.157 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T01:23:47.157 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.158 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.158 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.158 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:47 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.156+0000 7f205f7fe6c0 1 -- 10.20.193.40:0/2345638595 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+10508 (secure 0 0 0) 0x7f206c0a61a0 con 0x7f207410f200 2026-02-13T01:23:47.158 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:47.159 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":12,"btime":"2026-02-13T01:23:46:614565+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6835/265154799","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6834","nonce":265154799},{"type":"v1","addr":"10.20.193.40:6835","nonce":265154799}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14625,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6837/3247182877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6836","nonce":3247182877},{"type":"v1","addr":"10.20.193.40:6837","nonce":3247182877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6839/747178723","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6838","nonce":747178723},{"type":"v1","addr":"10.20.193.40:6839","nonce":747178723}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6841/800475237","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6840","nonce":800475237},{"type":"v1","addr":"10.20.193.40:6841","nonce":800475237}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24610,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6833/3201305130","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6832","nonce":3201305130},{"type":"v1","addr":"10.20.193.118:6833","nonce":3201305130}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24632,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6833/1911183527","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6832","nonce":1911183527},{"type":"v1","addr":"10.20.193.55:6833","nonce":1911183527}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6835/3508006300","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6834","nonce":3508006300},{"type":"v1","addr":"10.20.193.118:6835","nonce":3508006300}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6837/3471585859","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6836","nonce":3471585859},{"type":"v1","addr":"10.20.193.118:6837","nonce":3471585859}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6835/155719398","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6834","nonce":155719398},{"type":"v1","addr":"10.20.193.55:6835","nonce":155719398}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24661,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6839/154749702","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6838","nonce":154749702},{"type":"v1","addr":"10.20.193.118:6839","nonce":154749702}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24671,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6837/3322353780","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6836","nonce":3322353780},{"type":"v1","addr":"10.20.193.55:6837","nonce":3322353780}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6839/316274596","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6838","nonce":316274596},{"type":"v1","addr":"10.20.193.55:6839","nonce":316274596}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2026-02-13T01:23:47.159 INFO:teuthology.orchestra.run.trial040.stderr:dumped fsmap epoch 12 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f20500b56b0 msgr2=0x7f20500d5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f20500b56b0 0x7f20500d5b60 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2074113d10 tx=0x7f2060009260 comp rx=0 tx=0).stop 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f207410f200 msgr2=0x7f2074102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f207410f200 0x7f2074102df0 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f206c00b710 tx=0x7f206c00bbe0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 shutdown_connections 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f20500b56b0 0x7f20500d5b60 unknown :-1 s=CLOSED pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2074103420 0x7f207405d9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2074115410 0x7f2074175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 --2- 10.20.193.40:0/2345638595 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f207410f200 0x7f2074102df0 unknown :-1 s=CLOSED pgs=170 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.158+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 >> 10.20.193.40:0/2345638595 conn(0x7f20740ecb00 msgr2=0x7f207410d720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:47.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.159+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 shutdown_connections 2026-02-13T01:23:47.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.159+0000 7f207c81b6c0 1 -- 10.20.193.40:0/2345638595 wait complete. 2026-02-13T01:23:47.305 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-13T01:23:47.489 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:47.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:47 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.55:6838/316274596,v1:10.20.193.55:6839/316274596] up:boot 2026-02-13T01:23:47.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:47 trial055 ceph-mon[27509]: fsmap 12 up:standby 2026-02-13T01:23:47.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T01:23:47.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:47 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:47 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.55:6838/316274596,v1:10.20.193.55:6839/316274596] up:boot 2026-02-13T01:23:47.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:47 trial118 ceph-mon[27812]: fsmap 12 up:standby 2026-02-13T01:23:47.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T01:23:47.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:47 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:47.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.689+0000 7f062de3c6c0 1 -- 10.20.193.40:0/1459941200 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0628115410 msgr2=0x7f0628175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.689+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/1459941200 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0628115410 0x7f0628175db0 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=5524040341628029977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f061c00aa70 tx=0x7f061c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.689+0000 7f062de3c6c0 1 -- 10.20.193.40:0/1459941200 shutdown_connections 2026-02-13T01:23:47.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.689+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/1459941200 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0628115410 0x7f0628175db0 unknown :-1 s=CLOSED pgs=171 gs=1 cs=0 l=1 c_cookie=5524040341628029977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.689+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/1459941200 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f062810fbf0 0x7f0628114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.689+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/1459941200 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f062810f200 0x7f062810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.689+0000 7f062de3c6c0 1 -- 10.20.193.40:0/1459941200 >> 10.20.193.40:0/1459941200 conn(0x7f06280ecb00 msgr2=0x7f062810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:47.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.689+0000 7f062de3c6c0 1 -- 10.20.193.40:0/1459941200 shutdown_connections 2026-02-13T01:23:47.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.689+0000 7f062de3c6c0 1 -- 10.20.193.40:0/1459941200 wait complete. 2026-02-13T01:23:47.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f062de3c6c0 1 Processor -- start 2026-02-13T01:23:47.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f062de3c6c0 1 -- start start 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f062de3c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f062810f200 0x7f062811cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f062de3c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0628115410 0x7f062811d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f062de3c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0628122860 0x7f0628122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f062de3c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0628123270 con 0x7f062810f200 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f062de3c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f06281233e0 con 0x7f0628115410 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f062de3c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f06281235a0 con 0x7f0628122860 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f06277fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f062810f200 0x7f062811cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f06277fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f062810f200 0x7f062811cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55256/0 (socket says 10.20.193.40:55256) 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f06277fe6c0 1 -- 10.20.193.40:0/597368777 learned_addr learned my addr 10.20.193.40:0/597368777 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f0627fff6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0628122860 0x7f0628122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.690+0000 7f0626ffd6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0628115410 0x7f062811d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f06277fe6c0 1 -- 10.20.193.40:0/597368777 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0628122860 msgr2=0x7f0628122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f06277fe6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0628122860 0x7f0628122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f06277fe6c0 1 -- 10.20.193.40:0/597368777 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0628115410 msgr2=0x7f062811d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f06277fe6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0628115410 0x7f062811d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f06277fe6c0 1 -- 10.20.193.40:0/597368777 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061c00a660 con 0x7f062810f200 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f0627fff6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0628122860 0x7f0628122d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f0626ffd6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0628115410 0x7f062811d4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f06277fe6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f062810f200 0x7f062811cf60 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0614009490 tx=0x7f061400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f0624ff96c0 1 -- 10.20.193.40:0/597368777 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0614004a80 con 0x7f062810f200 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f0624ff96c0 1 -- 10.20.193.40:0/597368777 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0614009030 con 0x7f062810f200 2026-02-13T01:23:47.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f0624ff96c0 1 -- 10.20.193.40:0/597368777 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f06140071c0 con 0x7f062810f200 2026-02-13T01:23:47.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.691+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0628163a50 con 0x7f062810f200 2026-02-13T01:23:47.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.692+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0628163ee0 con 0x7f062810f200 2026-02-13T01:23:47.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.692+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06281104d0 con 0x7f062810f200 2026-02-13T01:23:47.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.694+0000 7f0624ff96c0 1 -- 10.20.193.40:0/597368777 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0614004e90 con 0x7f062810f200 2026-02-13T01:23:47.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.696+0000 7f0624ff96c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f05fc0b56d0 0x7f05fc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.696+0000 7f0624ff96c0 1 -- 10.20.193.40:0/597368777 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f06140e3880 con 0x7f062810f200 2026-02-13T01:23:47.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.696+0000 7f0626ffd6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f05fc0b56d0 0x7f05fc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.696+0000 7f0626ffd6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f05fc0b56d0 0x7f05fc0d5b80 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06281238f0 tx=0x7f0618009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:47.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.697+0000 7f0624ff96c0 1 -- 10.20.193.40:0/597368777 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f06140a66d0 con 0x7f062810f200 2026-02-13T01:23:47.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.800+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f062810fbf0 con 0x7f062810f200 2026-02-13T01:23:47.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.800+0000 7f0624ff96c0 1 -- 10.20.193.40:0/597368777 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f06140a9880 con 0x7f062810f200 2026-02-13T01:23:47.803 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:47.803 INFO:teuthology.orchestra.run.trial040.stdout:[ 2026-02-13T01:23:47.803 INFO:teuthology.orchestra.run.trial040.stdout: { 2026-02-13T01:23:47.803 INFO:teuthology.orchestra.run.trial040.stdout: "poolnum": 1, 2026-02-13T01:23:47.803 INFO:teuthology.orchestra.run.trial040.stdout: "poolname": ".mgr" 2026-02-13T01:23:47.804 INFO:teuthology.orchestra.run.trial040.stdout: } 2026-02-13T01:23:47.804 INFO:teuthology.orchestra.run.trial040.stdout:] 2026-02-13T01:23:47.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f05fc0b56d0 msgr2=0x7f05fc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f05fc0b56d0 0x7f05fc0d5b80 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06281238f0 tx=0x7f0618009260 comp rx=0 tx=0).stop 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f062810f200 msgr2=0x7f062811cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f062810f200 0x7f062811cf60 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0614009490 tx=0x7f061400bc50 comp rx=0 tx=0).stop 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 shutdown_connections 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f05fc0b56d0 0x7f05fc0d5b80 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0628122860 0x7f0628122d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0628115410 0x7f062811d4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 --2- 10.20.193.40:0/597368777 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f062810f200 0x7f062811cf60 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 >> 10.20.193.40:0/597368777 conn(0x7f06280ecb00 msgr2=0x7f062810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.801+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 shutdown_connections 2026-02-13T01:23:47.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:47.802+0000 7f062de3c6c0 1 -- 10.20.193.40:0/597368777 wait complete. 2026-02-13T01:23:47.907 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-13T01:23:47.907 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-13T01:23:48.093 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:48.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.279+0000 7efe253c76c0 1 -- 10.20.193.40:0/3415453447 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe20112ff0 msgr2=0x7efe20173990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:48.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.279+0000 7efe253c76c0 1 --2- 10.20.193.40:0/3415453447 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe20112ff0 0x7efe20173990 secure :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=7008896840693921677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe1400aa70 tx=0x7efe1402fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.279+0000 7efe253c76c0 1 -- 10.20.193.40:0/3415453447 shutdown_connections 2026-02-13T01:23:48.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.279+0000 7efe253c76c0 1 --2- 10.20.193.40:0/3415453447 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe20112ff0 0x7efe20173990 unknown :-1 s=CLOSED pgs=173 gs=1 cs=0 l=1 c_cookie=7008896840693921677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.279+0000 7efe253c76c0 1 --2- 10.20.193.40:0/3415453447 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe2010d7d0 0x7efe20112810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.279+0000 7efe253c76c0 1 --2- 10.20.193.40:0/3415453447 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2010cde0 0x7efe2010d1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.279+0000 7efe253c76c0 1 -- 10.20.193.40:0/3415453447 >> 10.20.193.40:0/3415453447 conn(0x7efe200ea6a0 msgr2=0x7efe2010aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:48.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.279+0000 7efe253c76c0 1 -- 10.20.193.40:0/3415453447 shutdown_connections 2026-02-13T01:23:48.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.279+0000 7efe253c76c0 1 -- 10.20.193.40:0/3415453447 wait complete. 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.280+0000 7efe253c76c0 1 Processor -- start 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.280+0000 7efe253c76c0 1 -- start start 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.280+0000 7efe253c76c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2010cde0 0x7efe200f4740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.280+0000 7efe253c76c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe20112ff0 0x7efe20173890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.280+0000 7efe253c76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe200f4d70 0x7efe200fa040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.280+0000 7efe253c76c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efe200f5460 con 0x7efe200f4d70 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.280+0000 7efe253c76c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7efe200fa580 con 0x7efe20112ff0 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.280+0000 7efe253c76c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7efe200fa740 con 0x7efe2010cde0 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe24bc66c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe200f4d70 0x7efe200fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:48.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe24bc66c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe200f4d70 0x7efe200fa040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55264/0 (socket says 10.20.193.40:55264) 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe24bc66c0 1 -- 10.20.193.40:0/4285853118 learned_addr learned my addr 10.20.193.40:0/4285853118 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe1f7fe6c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe20112ff0 0x7efe20173890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe1ffff6c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2010cde0 0x7efe200f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe24bc66c0 1 -- 10.20.193.40:0/4285853118 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2010cde0 msgr2=0x7efe200f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe24bc66c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2010cde0 0x7efe200f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe24bc66c0 1 -- 10.20.193.40:0/4285853118 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe20112ff0 msgr2=0x7efe20173890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe24bc66c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe20112ff0 0x7efe20173890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe24bc66c0 1 -- 10.20.193.40:0/4285853118 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1400a660 con 0x7efe200f4d70 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe1ffff6c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2010cde0 0x7efe200f4740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe24bc66c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe200f4d70 0x7efe200fa040 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe1400ab70 tx=0x7efe14032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:48.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe1d7fa6c0 1 -- 10.20.193.40:0/4285853118 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe140055a0 con 0x7efe200f4d70 2026-02-13T01:23:48.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe1d7fa6c0 1 -- 10.20.193.40:0/4285853118 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efe14005700 con 0x7efe200f4d70 2026-02-13T01:23:48.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe1d7fa6c0 1 -- 10.20.193.40:0/4285853118 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe14008ea0 con 0x7efe200f4d70 2026-02-13T01:23:48.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe200fa9c0 con 0x7efe200f4d70 2026-02-13T01:23:48.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.281+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe200fae40 con 0x7efe200f4d70 2026-02-13T01:23:48.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.282+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe2010e0b0 con 0x7efe200f4d70 2026-02-13T01:23:48.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.284+0000 7efe1d7fa6c0 1 -- 10.20.193.40:0/4285853118 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7efe14008700 con 0x7efe200f4d70 2026-02-13T01:23:48.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.286+0000 7efe1d7fa6c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdf40b56d0 0x7efdf40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:48.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.286+0000 7efe1d7fa6c0 1 -- 10.20.193.40:0/4285853118 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7efe141089b0 con 0x7efe200f4d70 2026-02-13T01:23:48.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.286+0000 7efe1d7fa6c0 1 -- 10.20.193.40:0/4285853118 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efe14108e30 con 0x7efe200f4d70 2026-02-13T01:23:48.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.286+0000 7efe1ffff6c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdf40b56d0 0x7efdf40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:48.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.286+0000 7efe1ffff6c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdf40b56d0 0x7efdf40d5b80 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe0c004750 tx=0x7efe0c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:48.391 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:48 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2345638595' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:48.391 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:48.391 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:48 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:48.391 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:48 trial118 ceph-mon[27812]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:48.391 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:48 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/597368777' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T01:23:48.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:48.388+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efe2010d1b0 con 0x7efe200f4d70 2026-02-13T01:23:48.392 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:48 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2345638595' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:48.392 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:48.392 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:48 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:48.392 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:48 trial040 ceph-mon[23046]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:48.392 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:48 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/597368777' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T01:23:48.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:48 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2345638595' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:23:48.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:48.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:48 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:48.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:48 trial055 ceph-mon[27509]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:48.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:48 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/597368777' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T01:23:49.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.304+0000 7efe1d7fa6c0 1 -- 10.20.193.40:0/4285853118 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7efe140cb7c0 con 0x7efe200f4d70 2026-02-13T01:23:49.307 INFO:teuthology.orchestra.run.trial040.stderr:pool 'cephfs_metadata' created 2026-02-13T01:23:49.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.307+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdf40b56d0 msgr2=0x7efdf40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:49.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.307+0000 7efe253c76c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdf40b56d0 0x7efdf40d5b80 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe0c004750 tx=0x7efe0c009260 comp rx=0 tx=0).stop 2026-02-13T01:23:49.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.307+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe200f4d70 msgr2=0x7efe200fa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:49.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.307+0000 7efe253c76c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe200f4d70 0x7efe200fa040 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe1400ab70 tx=0x7efe14032f60 comp rx=0 tx=0).stop 2026-02-13T01:23:49.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.308+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 shutdown_connections 2026-02-13T01:23:49.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.308+0000 7efe253c76c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdf40b56d0 0x7efdf40d5b80 unknown :-1 s=CLOSED pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.308+0000 7efe253c76c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe200f4d70 0x7efe200fa040 unknown :-1 s=CLOSED pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.308+0000 7efe253c76c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe20112ff0 0x7efe20173890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.308+0000 7efe253c76c0 1 --2- 10.20.193.40:0/4285853118 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2010cde0 0x7efe200f4740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.308+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 >> 10.20.193.40:0/4285853118 conn(0x7efe200ea6a0 msgr2=0x7efe20111670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:49.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.308+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 shutdown_connections 2026-02-13T01:23:49.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.308+0000 7efe253c76c0 1 -- 10.20.193.40:0/4285853118 wait complete. 2026-02-13T01:23:49.324 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.324 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4285853118' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:49.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:49 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:49.415 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-13T01:23:49.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:49.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:49.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:49.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:49.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:23:49.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4285853118' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:23:49.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:49.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:49 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:49.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4285853118' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:23:49.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:49.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:49 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:49.602 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:49.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.808+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/2456190958 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbc8811aa50 msgr2=0x7fbc8817b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:49.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.808+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/2456190958 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbc8811aa50 0x7fbc8817b3f0 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=7470629263841388271 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc8400aa70 tx=0x7fbc8402fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.808+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/2456190958 shutdown_connections 2026-02-13T01:23:49.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.808+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/2456190958 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbc8811aa50 0x7fbc8817b3f0 unknown :-1 s=CLOSED pgs=85 gs=1 cs=0 l=1 c_cookie=7470629263841388271 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.808+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/2456190958 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbc88115230 0x7fbc8811a270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.808+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/2456190958 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbc88114840 0x7fbc88114c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.808+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/2456190958 >> 10.20.193.40:0/2456190958 conn(0x7fbc8805cef0 msgr2=0x7fbc8805d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:49.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.808+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/2456190958 shutdown_connections 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.808+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/2456190958 wait complete. 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ed2b6c0 1 Processor -- start 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ed2b6c0 1 -- start start 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ed2b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbc88114840 0x7fbc880fe890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ed2b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbc8811aa50 0x7fbc8817b2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ed2b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbc880feec0 0x7fbc88104190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ed2b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbc880ff520 con 0x7fbc88114840 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ed2b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbc881046d0 con 0x7fbc8811aa50 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ed2b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbc88104890 con 0x7fbc880feec0 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ca9c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbc88114840 0x7fbc880fe890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:49.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc7ffff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbc8811aa50 0x7fbc8817b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ca9c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbc88114840 0x7fbc880fe890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55280/0 (socket says 10.20.193.40:55280) 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.809+0000 7fbc8ca9c6c0 1 -- 10.20.193.40:0/1890770841 learned_addr learned my addr 10.20.193.40:0/1890770841 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc8d29d6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbc880feec0 0x7fbc88104190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc7ffff6c0 1 -- 10.20.193.40:0/1890770841 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbc880feec0 msgr2=0x7fbc88104190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc7ffff6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbc880feec0 0x7fbc88104190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc7ffff6c0 1 -- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbc88114840 msgr2=0x7fbc880fe890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc7ffff6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbc88114840 0x7fbc880fe890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc7ffff6c0 1 -- 10.20.193.40:0/1890770841 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8400a660 con 0x7fbc8811aa50 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc8ca9c6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbc88114840 0x7fbc880fe890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc7ffff6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbc8811aa50 0x7fbc8817b2f0 secure :-1 s=READY pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc70004750 tx=0x7fbc7000bb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc7dffb6c0 1 -- 10.20.193.40:0/1890770841 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc70004a80 con 0x7fbc8811aa50 2026-02-13T01:23:49.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc88104b10 con 0x7fbc8811aa50 2026-02-13T01:23:49.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc7dffb6c0 1 -- 10.20.193.40:0/1890770841 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbc70009030 con 0x7fbc8811aa50 2026-02-13T01:23:49.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc7dffb6c0 1 -- 10.20.193.40:0/1890770841 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc700071c0 con 0x7fbc8811aa50 2026-02-13T01:23:49.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.810+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc88104ff0 con 0x7fbc8811aa50 2026-02-13T01:23:49.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.811+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc88115b10 con 0x7fbc8811aa50 2026-02-13T01:23:49.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.813+0000 7fbc7dffb6c0 1 -- 10.20.193.40:0/1890770841 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fbc70004060 con 0x7fbc8811aa50 2026-02-13T01:23:49.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.814+0000 7fbc7dffb6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbc640b5650 0x7fbc640d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:49.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.814+0000 7fbc7dffb6c0 1 -- 10.20.193.40:0/1890770841 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7492+0+0 (secure 0 0 0) 0x7fbc700e36d0 con 0x7fbc8811aa50 2026-02-13T01:23:49.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.815+0000 7fbc7dffb6c0 1 -- 10.20.193.40:0/1890770841 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbc700e3b50 con 0x7fbc8811aa50 2026-02-13T01:23:49.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.815+0000 7fbc8ca9c6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbc640b5650 0x7fbc640d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:49.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.815+0000 7fbc8ca9c6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbc640b5650 0x7fbc640d5b00 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc78005f90 tx=0x7fbc78009410 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:49.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:49.918+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbc88114c10 con 0x7fbc8811aa50 2026-02-13T01:23:50.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:50.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4285853118' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T01:23:50.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T01:23:50.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1890770841' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:23:50.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:23:50.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:50.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:50.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.308+0000 7fbc7dffb6c0 1 -- 10.20.193.40:0/1890770841 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) ==== 170+0+0 (secure 0 0 0) 0x7fbc700a6360 con 0x7fbc8811aa50 2026-02-13T01:23:50.310 INFO:teuthology.orchestra.run.trial040.stderr:pool 'cephfs_data' created 2026-02-13T01:23:50.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbc640b5650 msgr2=0x7fbc640d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:50.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbc640b5650 0x7fbc640d5b00 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc78005f90 tx=0x7fbc78009410 comp rx=0 tx=0).stop 2026-02-13T01:23:50.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbc8811aa50 msgr2=0x7fbc8817b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:50.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbc8811aa50 0x7fbc8817b2f0 secure :-1 s=READY pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc70004750 tx=0x7fbc7000bb80 comp rx=0 tx=0).stop 2026-02-13T01:23:50.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 shutdown_connections 2026-02-13T01:23:50.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbc640b5650 0x7fbc640d5b00 unknown :-1 s=CLOSED pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbc880feec0 0x7fbc88104190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbc8811aa50 0x7fbc8817b2f0 unknown :-1 s=CLOSED pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 --2- 10.20.193.40:0/1890770841 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbc88114840 0x7fbc880fe890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.318+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 >> 10.20.193.40:0/1890770841 conn(0x7fbc8805cef0 msgr2=0x7fbc881167f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:50.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.319+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 shutdown_connections 2026-02-13T01:23:50.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.319+0000 7fbc8ed2b6c0 1 -- 10.20.193.40:0/1890770841 wait complete. 2026-02-13T01:23:50.366 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:50.366 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4285853118' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1890770841' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:50.367 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:50.425 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-13T01:23:50.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:50.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4285853118' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T01:23:50.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T01:23:50.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1890770841' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:23:50.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:23:50.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:50.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:50.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:50.611 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:50.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.800+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/1169599310 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b18115270 msgr2=0x7f0b18175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:50.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.800+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/1169599310 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b18115270 0x7f0b18175c10 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=10066283836207808155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b1400aa70 tx=0x7f0b1402fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.800+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/1169599310 shutdown_connections 2026-02-13T01:23:50.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.800+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/1169599310 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b18115270 0x7f0b18175c10 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=10066283836207808155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.800+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/1169599310 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b1810fa50 0x7f0b18114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.800+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/1169599310 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b1810f060 0x7f0b1810f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.800+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/1169599310 >> 10.20.193.40:0/1169599310 conn(0x7f0b180ec980 msgr2=0x7f0b1810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:50.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.800+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/1169599310 shutdown_connections 2026-02-13T01:23:50.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.800+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/1169599310 wait complete. 2026-02-13T01:23:50.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.801+0000 7f0b1dd076c0 1 Processor -- start 2026-02-13T01:23:50.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.801+0000 7f0b1dd076c0 1 -- start start 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.801+0000 7f0b1dd076c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b1810f060 0x7f0b1811cea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.801+0000 7f0b1dd076c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b18115270 0x7f0b1811d3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.801+0000 7f0b1dd076c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b181227a0 0x7f0b18122c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.801+0000 7f0b1dd076c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0b181231b0 con 0x7f0b181227a0 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.801+0000 7f0b1dd076c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0b18123320 con 0x7f0b18115270 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.801+0000 7f0b1dd076c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b181234e0 con 0x7f0b1810f060 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b0ffff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b18115270 0x7f0b1811d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b0ffff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b18115270 0x7f0b1811d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:51824/0 (socket says 10.20.193.40:51824) 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b0ffff6c0 1 -- 10.20.193.40:0/3637003946 learned_addr learned my addr 10.20.193.40:0/3637003946 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1d5066c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b181227a0 0x7f0b18122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:50.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1cd056c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b1810f060 0x7f0b1811cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1d5066c0 1 -- 10.20.193.40:0/3637003946 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b1810f060 msgr2=0x7f0b1811cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1d5066c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b1810f060 0x7f0b1811cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1d5066c0 1 -- 10.20.193.40:0/3637003946 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b18115270 msgr2=0x7f0b1811d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1d5066c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b18115270 0x7f0b1811d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1d5066c0 1 -- 10.20.193.40:0/3637003946 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1400a660 con 0x7f0b181227a0 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b0ffff6c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b18115270 0x7f0b1811d3e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1d5066c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b181227a0 0x7f0b18122c40 secure :-1 s=READY pgs=176 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b1400aa40 tx=0x7f0b14032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b0dffb6c0 1 -- 10.20.193.40:0/3637003946 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b14005520 con 0x7f0b181227a0 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b18163930 con 0x7f0b181227a0 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b0dffb6c0 1 -- 10.20.193.40:0/3637003946 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0b14005680 con 0x7f0b181227a0 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b0dffb6c0 1 -- 10.20.193.40:0/3637003946 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b140322b0 con 0x7f0b181227a0 2026-02-13T01:23:50.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.802+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b18163d60 con 0x7f0b181227a0 2026-02-13T01:23:50.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.803+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b18110330 con 0x7f0b181227a0 2026-02-13T01:23:50.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.806+0000 7f0b0dffb6c0 1 -- 10.20.193.40:0/3637003946 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0b14003810 con 0x7f0b181227a0 2026-02-13T01:23:50.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.807+0000 7f0b0dffb6c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0af40b56d0 0x7f0af40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:50.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.807+0000 7f0b0dffb6c0 1 -- 10.20.193.40:0/3637003946 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7877+0+0 (secure 0 0 0) 0x7f0b14108b10 con 0x7f0b181227a0 2026-02-13T01:23:50.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.807+0000 7f0b0dffb6c0 1 -- 10.20.193.40:0/3637003946 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0b141415e0 con 0x7f0b181227a0 2026-02-13T01:23:50.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.808+0000 7f0b1cd056c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0af40b56d0 0x7f0af40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:50.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.808+0000 7f0b1cd056c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0af40b56d0 0x7f0af40d5b80 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b08004750 tx=0x7f0b08009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:50.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:50.932+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0b1810f430 con 0x7f0b181227a0 2026-02-13T01:23:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: pgmap v171: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T01:23:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T01:23:51.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: pgmap v173: 97 pgs: 6 creating+peering, 87 unknown, 4 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:51.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3637003946' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:23:51.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:51 trial040 ceph-mon[23046]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T01:23:51.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.307+0000 7f0b0dffb6c0 1 -- 10.20.193.40:0/3637003946 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v13) ==== 172+0+0 (secure 0 0 0) 0x7f0b140cb620 con 0x7f0b181227a0 2026-02-13T01:23:51.309 INFO:teuthology.orchestra.run.trial040.stderr:new fs with metadata pool 2 and data pool 3 2026-02-13T01:23:51.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0af40b56d0 msgr2=0x7f0af40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:51.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0af40b56d0 0x7f0af40d5b80 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b08004750 tx=0x7f0b08009260 comp rx=0 tx=0).stop 2026-02-13T01:23:51.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b181227a0 msgr2=0x7f0b18122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:51.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b181227a0 0x7f0b18122c40 secure :-1 s=READY pgs=176 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b1400aa40 tx=0x7f0b14032f60 comp rx=0 tx=0).stop 2026-02-13T01:23:51.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 shutdown_connections 2026-02-13T01:23:51.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0af40b56d0 0x7f0af40d5b80 unknown :-1 s=CLOSED pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b181227a0 0x7f0b18122c40 unknown :-1 s=CLOSED pgs=176 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b18115270 0x7f0b1811d3e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 --2- 10.20.193.40:0/3637003946 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b1810f060 0x7f0b1811cea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 >> 10.20.193.40:0/3637003946 conn(0x7f0b180ec980 msgr2=0x7f0b1810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:51.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 shutdown_connections 2026-02-13T01:23:51.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.310+0000 7f0b1dd076c0 1 -- 10.20.193.40:0/3637003946 wait complete. 2026-02-13T01:23:51.416 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:23:51.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:51.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: pgmap v171: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:51.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:51.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:51.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T01:23:51.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T01:23:51.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: pgmap v173: 97 pgs: 6 creating+peering, 87 unknown, 4 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:51.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3637003946' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:23:51.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:51 trial055 ceph-mon[27509]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T01:23:51.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:23:51.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: pgmap v171: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:51.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:51.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:51.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T01:23:51.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T01:23:51.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: pgmap v173: 97 pgs: 6 creating+peering, 87 unknown, 4 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:51.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3637003946' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:23:51.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:51 trial118 ceph-mon[27812]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T01:23:51.600 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:51.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.806+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3077159442 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c2010fbf0 msgr2=0x7f5c20114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.806+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3077159442 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c2010fbf0 0x7f5c20114c30 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=13797817569166963167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c140099a0 tx=0x7f5c1402ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.807+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3077159442 shutdown_connections 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.807+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3077159442 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5c20115410 0x7f5c20175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.807+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3077159442 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c2010fbf0 0x7f5c20114c30 unknown :-1 s=CLOSED pgs=177 gs=1 cs=0 l=1 c_cookie=13797817569166963167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.807+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3077159442 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5c2010f200 0x7f5c2010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.807+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3077159442 >> 10.20.193.40:0/3077159442 conn(0x7f5c200ecb00 msgr2=0x7f5c2010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.807+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3077159442 shutdown_connections 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.807+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3077159442 wait complete. 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.807+0000 7f5c27f5b6c0 1 Processor -- start 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c27f5b6c0 1 -- start start 2026-02-13T01:23:51.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c27f5b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5c2010f200 0x7f5c200f4990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c27f5b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5c20115410 0x7f5c20175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c27f5b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c200f4fc0 0x7f5c200fa240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c27f5b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5c200f56b0 con 0x7f5c200f4fc0 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c27f5b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5c200fa780 con 0x7f5c2010f200 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c27f5b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5c200fa940 con 0x7f5c20115410 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c264cd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c200f4fc0 0x7f5c200fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c264cd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c200f4fc0 0x7f5c200fa240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60026/0 (socket says 10.20.193.40:60026) 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c264cd6c0 1 -- 10.20.193.40:0/3329962866 learned_addr learned my addr 10.20.193.40:0/3329962866 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c254cb6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5c20115410 0x7f5c20175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:51.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c25ccc6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5c2010f200 0x7f5c200f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:51.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c264cd6c0 1 -- 10.20.193.40:0/3329962866 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5c20115410 msgr2=0x7f5c20175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:51.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c264cd6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5c20115410 0x7f5c20175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c264cd6c0 1 -- 10.20.193.40:0/3329962866 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5c2010f200 msgr2=0x7f5c200f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c264cd6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5c2010f200 0x7f5c200f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.808+0000 7f5c264cd6c0 1 -- 10.20.193.40:0/3329962866 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c14009590 con 0x7f5c200f4fc0 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.809+0000 7f5c264cd6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c200f4fc0 0x7f5c200fa240 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c1c006ea0 tx=0x7f5c1c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.809+0000 7f5c0effd6c0 1 -- 10.20.193.40:0/3329962866 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c1c003c40 con 0x7f5c200f4fc0 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.809+0000 7f5c0effd6c0 1 -- 10.20.193.40:0/3329962866 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5c1c003da0 con 0x7f5c200f4fc0 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.809+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c200fac20 con 0x7f5c200f4fc0 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.809+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c200fb0b0 con 0x7f5c200f4fc0 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.809+0000 7f5c0effd6c0 1 -- 10.20.193.40:0/3329962866 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c1c008440 con 0x7f5c200f4fc0 2026-02-13T01:23:51.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.809+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c201104d0 con 0x7f5c200f4fc0 2026-02-13T01:23:51.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.812+0000 7f5c0effd6c0 1 -- 10.20.193.40:0/3329962866 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f5c1c00d690 con 0x7f5c200f4fc0 2026-02-13T01:23:51.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.813+0000 7f5c0effd6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5bfc0b5650 0x7f5bfc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:51.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.813+0000 7f5c0effd6c0 1 -- 10.20.193.40:0/3329962866 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7977+0+0 (secure 0 0 0) 0x7f5c1c0e4a40 con 0x7f5c200f4fc0 2026-02-13T01:23:51.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.814+0000 7f5c0effd6c0 1 -- 10.20.193.40:0/3329962866 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5c1c11d5e0 con 0x7f5c200f4fc0 2026-02-13T01:23:51.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.814+0000 7f5c25ccc6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5bfc0b5650 0x7f5bfc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:51.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.814+0000 7f5c25ccc6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5bfc0b5650 0x7f5bfc0d5b00 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c10005dc0 tx=0x7f5c10005d10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:51.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.915+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c200fb0b0 con 0x7f5c200f4fc0 2026-02-13T01:23:51.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.915+0000 7f5c0effd6c0 1 -- 10.20.193.40:0/3329962866 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22330 (secure 0 0 0) 0x7f5c200fb0b0 con 0x7f5c200f4fc0 2026-02-13T01:23:51.917 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:51.917 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":73,"fsid":"304b456c-087a-11f1-98ea-d404e6e7d460","created":"2026-02-13T01:20:52.557389+0000","modified":"2026-02-13T01:23:50.933451+0000","last_up_change":"2026-02-13T01:23:30.097332+0000","last_in_change":"2026-02-13T01:23:21.835674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:22:12.069221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:23:48.399006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:23:49.929655+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6fb8271-19fd-4149-91ec-ed412cd5dc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6803","nonce":3956883177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6805","nonce":3956883177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6809","nonce":3956883177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6807","nonce":3956883177}]},"public_addr":"10.20.193.40:6803/3956883177","cluster_addr":"10.20.193.40:6805/3956883177","heartbeat_back_addr":"10.20.193.40:6809/3956883177","heartbeat_front_addr":"10.20.193.40:6807/3956883177","state":["exists","up"]},{"osd":1,"uuid":"3d8d3277-423d-455b-af0d-67d15aaea487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6800","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6801","nonce":3110028162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6802","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6803","nonce":3110028162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6806","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6807","nonce":3110028162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6804","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6805","nonce":3110028162}]},"public_addr":"10.20.193.55:6801/3110028162","cluster_addr":"10.20.193.55:6803/3110028162","heartbeat_back_addr":"10.20.193.55:6807/3110028162","heartbeat_front_addr":"10.20.193.55:6805/3110028162","state":["exists","up"]},{"osd":2,"uuid":"9d84270b-3934-48db-99a7-d6b8845c344d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6800","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6801","nonce":2584237293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6802","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6803","nonce":2584237293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6806","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6807","nonce":2584237293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6804","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6805","nonce":2584237293}]},"public_addr":"10.20.193.118:6801/2584237293","cluster_addr":"10.20.193.118:6803/2584237293","heartbeat_back_addr":"10.20.193.118:6807/2584237293","heartbeat_front_addr":"10.20.193.118:6805/2584237293","state":["exists","up"]},{"osd":3,"uuid":"d7a9da01-a235-4069-9e09-562abc3c2ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6811","nonce":485777007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6813","nonce":485777007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6817","nonce":485777007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6815","nonce":485777007}]},"public_addr":"10.20.193.40:6811/485777007","cluster_addr":"10.20.193.40:6813/485777007","heartbeat_back_addr":"10.20.193.40:6817/485777007","heartbeat_front_addr":"10.20.193.40:6815/485777007","state":["exists","up"]},{"osd":4,"uuid":"a3a5b0ea-f758-46ce-bd6d-afaa74db16bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6808","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6809","nonce":3166522039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6810","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6811","nonce":3166522039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6814","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6815","nonce":3166522039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6812","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6813","nonce":3166522039}]},"public_addr":"10.20.193.55:6809/3166522039","cluster_addr":"10.20.193.55:6811/3166522039","heartbeat_back_addr":"10.20.193.55:6815/3166522039","heartbeat_front_addr":"10.20.193.55:6813/3166522039","state":["exists","up"]},{"osd":5,"uuid":"785971ea-187d-4818-a068-2f11a062f7f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6808","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6809","nonce":674220568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6810","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6811","nonce":674220568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6814","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6815","nonce":674220568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6812","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6813","nonce":674220568}]},"public_addr":"10.20.193.118:6809/674220568","cluster_addr":"10.20.193.118:6811/674220568","heartbeat_back_addr":"10.20.193.118:6815/674220568","heartbeat_front_addr":"10.20.193.118:6813/674220568","state":["exists","up"]},{"osd":6,"uuid":"d852201c-70dd-4be3-af89-2a49bdf1e9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6819","nonce":3706078337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6821","nonce":3706078337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6824","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6825","nonce":3706078337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6823","nonce":3706078337}]},"public_addr":"10.20.193.40:6819/3706078337","cluster_addr":"10.20.193.40:6821/3706078337","heartbeat_back_addr":"10.20.193.40:6825/3706078337","heartbeat_front_addr":"10.20.193.40:6823/3706078337","state":["exists","up"]},{"osd":7,"uuid":"55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6816","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6817","nonce":1340798625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6818","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6819","nonce":1340798625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6822","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6823","nonce":1340798625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6820","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6821","nonce":1340798625}]},"public_addr":"10.20.193.55:6817/1340798625","cluster_addr":"10.20.193.55:6819/1340798625","heartbeat_back_addr":"10.20.193.55:6823/1340798625","heartbeat_front_addr":"10.20.193.55:6821/1340798625","state":["exists","up"]},{"osd":8,"uuid":"9a727c13-2b82-4465-9c5a-af294ba75403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6816","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6817","nonce":2741939670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6818","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6819","nonce":2741939670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6822","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6823","nonce":2741939670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6820","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6821","nonce":2741939670}]},"public_addr":"10.20.193.118:6817/2741939670","cluster_addr":"10.20.193.118:6819/2741939670","heartbeat_back_addr":"10.20.193.118:6823/2741939670","heartbeat_front_addr":"10.20.193.118:6821/2741939670","state":["exists","up"]},{"osd":9,"uuid":"2e674b08-c75c-41c1-a91b-09987dfb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6827","nonce":1636530405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6828","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6829","nonce":1636530405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6832","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6833","nonce":1636530405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6831","nonce":1636530405}]},"public_addr":"10.20.193.40:6827/1636530405","cluster_addr":"10.20.193.40:6829/1636530405","heartbeat_back_addr":"10.20.193.40:6833/1636530405","heartbeat_front_addr":"10.20.193.40:6831/1636530405","state":["exists","up"]},{"osd":10,"uuid":"c0253c41-b910-4637-aae8-5c00bc814dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6824","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6825","nonce":461194356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6826","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6827","nonce":461194356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6830","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6831","nonce":461194356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6828","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6829","nonce":461194356}]},"public_addr":"10.20.193.55:6825/461194356","cluster_addr":"10.20.193.55:6827/461194356","heartbeat_back_addr":"10.20.193.55:6831/461194356","heartbeat_front_addr":"10.20.193.55:6829/461194356","state":["exists","up"]},{"osd":11,"uuid":"de7616d6-df2d-4ade-8676-6c4e95da253c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6824","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6825","nonce":1832833901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6826","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6827","nonce":1832833901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6830","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6831","nonce":1832833901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6828","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6829","nonce":1832833901}]},"public_addr":"10.20.193.118:6825/1832833901","cluster_addr":"10.20.193.118:6827/1832833901","heartbeat_back_addr":"10.20.193.118:6831/1832833901","heartbeat_front_addr":"10.20.193.118:6829/1832833901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:21:55.803128+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:03.064285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:10.128421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:20.969922+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:28.580756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:35.696627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:46.838480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:54.619455+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:02.014372+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:12.955709+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:20.865741+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:28.300625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.40:6801/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:6800/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/743801918":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1188631814":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1549127191":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/4084024233":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/2202236316":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/3369709934":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6801/2001072148":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6800/2001072148":"2026-02-14T01:21:00.614882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:23:51.918 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5bfc0b5650 msgr2=0x7f5bfc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:51.918 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5bfc0b5650 0x7f5bfc0d5b00 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c10005dc0 tx=0x7f5c10005d10 comp rx=0 tx=0).stop 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c200f4fc0 msgr2=0x7f5c200fa240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c200f4fc0 0x7f5c200fa240 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c1c006ea0 tx=0x7f5c1c00ce50 comp rx=0 tx=0).stop 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 shutdown_connections 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5bfc0b5650 0x7f5bfc0d5b00 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5c200f4fc0 0x7f5c200fa240 unknown :-1 s=CLOSED pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5c20115410 0x7f5c20175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 --2- 10.20.193.40:0/3329962866 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5c2010f200 0x7f5c200f4990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 >> 10.20.193.40:0/3329962866 conn(0x7f5c200ecb00 msgr2=0x7f5c2010d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 shutdown_connections 2026-02-13T01:23:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:51.917+0000 7f5c27f5b6c0 1 -- 10.20.193.40:0/3329962866 wait complete. 2026-02-13T01:23:52.021 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:23:52.205 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:52.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:52 trial040 ceph-mon[23046]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T01:23:52.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:52 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3637003946' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T01:23:52.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:52 trial040 ceph-mon[23046]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T01:23:52.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:52 trial040 ceph-mon[23046]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T01:23:52.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:52 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3329962866' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:23:52.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.394+0000 7fe460a056c0 1 -- 10.20.193.40:0/923808928 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c1149c0 msgr2=0x7fe45c114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:52.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.394+0000 7fe460a056c0 1 --2- 10.20.193.40:0/923808928 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c1149c0 0x7fe45c114ee0 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=5232699428511381286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe44c00aa40 tx=0x7fe44c02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.394+0000 7fe460a056c0 1 -- 10.20.193.40:0/923808928 shutdown_connections 2026-02-13T01:23:52.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.394+0000 7fe460a056c0 1 --2- 10.20.193.40:0/923808928 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c1149c0 0x7fe45c114ee0 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=5232699428511381286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.394+0000 7fe460a056c0 1 --2- 10.20.193.40:0/923808928 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe45c113dc0 0x7fe45c114210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.394+0000 7fe460a056c0 1 --2- 10.20.193.40:0/923808928 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe45c11b510 0x7fe45c11b8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.394+0000 7fe460a056c0 1 -- 10.20.193.40:0/923808928 >> 10.20.193.40:0/923808928 conn(0x7fe45c058a50 msgr2=0x7fe45c058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:52.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.395+0000 7fe460a056c0 1 -- 10.20.193.40:0/923808928 shutdown_connections 2026-02-13T01:23:52.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.395+0000 7fe460a056c0 1 -- 10.20.193.40:0/923808928 wait complete. 2026-02-13T01:23:52.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.395+0000 7fe460a056c0 1 Processor -- start 2026-02-13T01:23:52.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.395+0000 7fe460a056c0 1 -- start start 2026-02-13T01:23:52.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe460a056c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c113dc0 0x7fe45c12b870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:52.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe460a056c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe45c1149c0 0x7fe45c12bdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:52.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe460a056c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe45c11b510 0x7fe45c131120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:52.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe460a056c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c131770 con 0x7fe45c113dc0 2026-02-13T01:23:52.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe460a056c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c1318e0 con 0x7fe45c1149c0 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe460a056c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c131aa0 con 0x7fe45c11b510 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45a5756c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c113dc0 0x7fe45c12b870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45a5756c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c113dc0 0x7fe45c12b870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60042/0 (socket says 10.20.193.40:60042) 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45a5756c0 1 -- 10.20.193.40:0/1648422633 learned_addr learned my addr 10.20.193.40:0/1648422633 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45ad766c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe45c11b510 0x7fe45c131120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe459d746c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe45c1149c0 0x7fe45c12bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45a5756c0 1 -- 10.20.193.40:0/1648422633 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe45c11b510 msgr2=0x7fe45c131120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45a5756c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe45c11b510 0x7fe45c131120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45a5756c0 1 -- 10.20.193.40:0/1648422633 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe45c1149c0 msgr2=0x7fe45c12bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45a5756c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe45c1149c0 0x7fe45c12bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45a5756c0 1 -- 10.20.193.40:0/1648422633 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c00a660 con 0x7fe45c113dc0 2026-02-13T01:23:52.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe45a5756c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c113dc0 0x7fe45c12b870 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe45000b6c0 tx=0x7fe45000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:52.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe4437fe6c0 1 -- 10.20.193.40:0/1648422633 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4500044a0 con 0x7fe45c113dc0 2026-02-13T01:23:52.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe4437fe6c0 1 -- 10.20.193.40:0/1648422633 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe45000be50 con 0x7fe45c113dc0 2026-02-13T01:23:52.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.396+0000 7fe4437fe6c0 1 -- 10.20.193.40:0/1648422633 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe45000e070 con 0x7fe45c113dc0 2026-02-13T01:23:52.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.397+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45c131d80 con 0x7fe45c113dc0 2026-02-13T01:23:52.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.397+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe45c172460 con 0x7fe45c113dc0 2026-02-13T01:23:52.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.397+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45c131fa0 con 0x7fe45c113dc0 2026-02-13T01:23:52.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.399+0000 7fe4437fe6c0 1 -- 10.20.193.40:0/1648422633 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fe45000c530 con 0x7fe45c113dc0 2026-02-13T01:23:52.402 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.401+0000 7fe4437fe6c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe4340b56d0 0x7fe4340d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:52.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.401+0000 7fe4437fe6c0 1 -- 10.20.193.40:0/1648422633 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fe4500e3810 con 0x7fe45c113dc0 2026-02-13T01:23:52.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.401+0000 7fe459d746c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe4340b56d0 0x7fe4340d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:52.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.401+0000 7fe4437fe6c0 1 -- 10.20.193.40:0/1648422633 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe4500e3c90 con 0x7fe45c113dc0 2026-02-13T01:23:52.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.402+0000 7fe459d746c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe4340b56d0 0x7fe4340d5b80 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe444006b60 tx=0x7fe444006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:52.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:52 trial055 ceph-mon[27509]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T01:23:52.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:52 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3637003946' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T01:23:52.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:52 trial055 ceph-mon[27509]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T01:23:52.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:52 trial055 ceph-mon[27509]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T01:23:52.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:52 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3329962866' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:23:52.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:52 trial118 ceph-mon[27812]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T01:23:52.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:52 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3637003946' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T01:23:52.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:52 trial118 ceph-mon[27812]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T01:23:52.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:52 trial118 ceph-mon[27812]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T01:23:52.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:52 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3329962866' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:23:52.504 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.502+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe45c05b000 con 0x7fe45c113dc0 2026-02-13T01:23:52.505 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.503+0000 7fe4437fe6c0 1 -- 10.20.193.40:0/1648422633 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22317 (secure 0 0 0) 0x7fe4500a6350 con 0x7fe45c113dc0 2026-02-13T01:23:52.506 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:23:52.506 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":74,"fsid":"304b456c-087a-11f1-98ea-d404e6e7d460","created":"2026-02-13T01:20:52.557389+0000","modified":"2026-02-13T01:23:52.076554+0000","last_up_change":"2026-02-13T01:23:30.097332+0000","last_in_change":"2026-02-13T01:23:21.835674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:22:12.069221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:23:48.399006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:23:49.929655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6fb8271-19fd-4149-91ec-ed412cd5dc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6803","nonce":3956883177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6805","nonce":3956883177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6809","nonce":3956883177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6807","nonce":3956883177}]},"public_addr":"10.20.193.40:6803/3956883177","cluster_addr":"10.20.193.40:6805/3956883177","heartbeat_back_addr":"10.20.193.40:6809/3956883177","heartbeat_front_addr":"10.20.193.40:6807/3956883177","state":["exists","up"]},{"osd":1,"uuid":"3d8d3277-423d-455b-af0d-67d15aaea487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6800","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6801","nonce":3110028162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6802","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6803","nonce":3110028162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6806","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6807","nonce":3110028162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6804","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6805","nonce":3110028162}]},"public_addr":"10.20.193.55:6801/3110028162","cluster_addr":"10.20.193.55:6803/3110028162","heartbeat_back_addr":"10.20.193.55:6807/3110028162","heartbeat_front_addr":"10.20.193.55:6805/3110028162","state":["exists","up"]},{"osd":2,"uuid":"9d84270b-3934-48db-99a7-d6b8845c344d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6800","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6801","nonce":2584237293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6802","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6803","nonce":2584237293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6806","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6807","nonce":2584237293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6804","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6805","nonce":2584237293}]},"public_addr":"10.20.193.118:6801/2584237293","cluster_addr":"10.20.193.118:6803/2584237293","heartbeat_back_addr":"10.20.193.118:6807/2584237293","heartbeat_front_addr":"10.20.193.118:6805/2584237293","state":["exists","up"]},{"osd":3,"uuid":"d7a9da01-a235-4069-9e09-562abc3c2ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6811","nonce":485777007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6813","nonce":485777007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6817","nonce":485777007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6815","nonce":485777007}]},"public_addr":"10.20.193.40:6811/485777007","cluster_addr":"10.20.193.40:6813/485777007","heartbeat_back_addr":"10.20.193.40:6817/485777007","heartbeat_front_addr":"10.20.193.40:6815/485777007","state":["exists","up"]},{"osd":4,"uuid":"a3a5b0ea-f758-46ce-bd6d-afaa74db16bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6808","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6809","nonce":3166522039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6810","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6811","nonce":3166522039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6814","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6815","nonce":3166522039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6812","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6813","nonce":3166522039}]},"public_addr":"10.20.193.55:6809/3166522039","cluster_addr":"10.20.193.55:6811/3166522039","heartbeat_back_addr":"10.20.193.55:6815/3166522039","heartbeat_front_addr":"10.20.193.55:6813/3166522039","state":["exists","up"]},{"osd":5,"uuid":"785971ea-187d-4818-a068-2f11a062f7f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6808","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6809","nonce":674220568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6810","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6811","nonce":674220568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6814","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6815","nonce":674220568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6812","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6813","nonce":674220568}]},"public_addr":"10.20.193.118:6809/674220568","cluster_addr":"10.20.193.118:6811/674220568","heartbeat_back_addr":"10.20.193.118:6815/674220568","heartbeat_front_addr":"10.20.193.118:6813/674220568","state":["exists","up"]},{"osd":6,"uuid":"d852201c-70dd-4be3-af89-2a49bdf1e9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6819","nonce":3706078337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6821","nonce":3706078337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6824","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6825","nonce":3706078337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6823","nonce":3706078337}]},"public_addr":"10.20.193.40:6819/3706078337","cluster_addr":"10.20.193.40:6821/3706078337","heartbeat_back_addr":"10.20.193.40:6825/3706078337","heartbeat_front_addr":"10.20.193.40:6823/3706078337","state":["exists","up"]},{"osd":7,"uuid":"55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6816","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6817","nonce":1340798625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6818","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6819","nonce":1340798625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6822","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6823","nonce":1340798625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6820","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6821","nonce":1340798625}]},"public_addr":"10.20.193.55:6817/1340798625","cluster_addr":"10.20.193.55:6819/1340798625","heartbeat_back_addr":"10.20.193.55:6823/1340798625","heartbeat_front_addr":"10.20.193.55:6821/1340798625","state":["exists","up"]},{"osd":8,"uuid":"9a727c13-2b82-4465-9c5a-af294ba75403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6816","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6817","nonce":2741939670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6818","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6819","nonce":2741939670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6822","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6823","nonce":2741939670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6820","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6821","nonce":2741939670}]},"public_addr":"10.20.193.118:6817/2741939670","cluster_addr":"10.20.193.118:6819/2741939670","heartbeat_back_addr":"10.20.193.118:6823/2741939670","heartbeat_front_addr":"10.20.193.118:6821/2741939670","state":["exists","up"]},{"osd":9,"uuid":"2e674b08-c75c-41c1-a91b-09987dfb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6827","nonce":1636530405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6828","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6829","nonce":1636530405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6832","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6833","nonce":1636530405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6831","nonce":1636530405}]},"public_addr":"10.20.193.40:6827/1636530405","cluster_addr":"10.20.193.40:6829/1636530405","heartbeat_back_addr":"10.20.193.40:6833/1636530405","heartbeat_front_addr":"10.20.193.40:6831/1636530405","state":["exists","up"]},{"osd":10,"uuid":"c0253c41-b910-4637-aae8-5c00bc814dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6824","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6825","nonce":461194356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6826","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6827","nonce":461194356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6830","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6831","nonce":461194356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6828","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6829","nonce":461194356}]},"public_addr":"10.20.193.55:6825/461194356","cluster_addr":"10.20.193.55:6827/461194356","heartbeat_back_addr":"10.20.193.55:6831/461194356","heartbeat_front_addr":"10.20.193.55:6829/461194356","state":["exists","up"]},{"osd":11,"uuid":"de7616d6-df2d-4ade-8676-6c4e95da253c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6824","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6825","nonce":1832833901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6826","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6827","nonce":1832833901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6830","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6831","nonce":1832833901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6828","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6829","nonce":1832833901}]},"public_addr":"10.20.193.118:6825/1832833901","cluster_addr":"10.20.193.118:6827/1832833901","heartbeat_back_addr":"10.20.193.118:6831/1832833901","heartbeat_front_addr":"10.20.193.118:6829/1832833901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:21:55.803128+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:03.064285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:10.128421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:20.969922+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:28.580756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:35.696627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:46.838480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:54.619455+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:02.014372+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:12.955709+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:20.865741+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:28.300625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.40:6801/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:6800/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/743801918":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1188631814":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1549127191":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/4084024233":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/2202236316":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/3369709934":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6801/2001072148":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6800/2001072148":"2026-02-14T01:21:00.614882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:23:52.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe4340b56d0 msgr2=0x7fe4340d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe4340b56d0 0x7fe4340d5b80 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe444006b60 tx=0x7fe444006af0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c113dc0 msgr2=0x7fe45c12b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c113dc0 0x7fe45c12b870 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe45000b6c0 tx=0x7fe45000bb90 comp rx=0 tx=0).stop 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 shutdown_connections 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe4340b56d0 0x7fe4340d5b80 unknown :-1 s=CLOSED pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe45c11b510 0x7fe45c131120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe45c1149c0 0x7fe45c12bdb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 --2- 10.20.193.40:0/1648422633 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe45c113dc0 0x7fe45c12b870 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 >> 10.20.193.40:0/1648422633 conn(0x7fe45c058a50 msgr2=0x7fe45c059a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 shutdown_connections 2026-02-13T01:23:52.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.504+0000 7fe460a056c0 1 -- 10.20.193.40:0/1648422633 wait complete. 2026-02-13T01:23:52.608 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-13T01:23:52.801 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:52.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.989+0000 7f70e89d66c0 1 -- 10.20.193.40:0/726582930 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e410fa50 msgr2=0x7f70e4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:52.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.989+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/726582930 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e410fa50 0x7f70e4114a90 secure :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=1745594006000103296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70d40099a0 tx=0x7f70d402ed00 comp rx=0 tx=0).stop 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.989+0000 7f70e89d66c0 1 -- 10.20.193.40:0/726582930 shutdown_connections 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.989+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/726582930 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f70e4115270 0x7f70e4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.989+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/726582930 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e410fa50 0x7f70e4114a90 unknown :-1 s=CLOSED pgs=181 gs=1 cs=0 l=1 c_cookie=1745594006000103296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.989+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/726582930 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f70e410f060 0x7f70e410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.989+0000 7f70e89d66c0 1 -- 10.20.193.40:0/726582930 >> 10.20.193.40:0/726582930 conn(0x7f70e40ec980 msgr2=0x7f70e410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.989+0000 7f70e89d66c0 1 -- 10.20.193.40:0/726582930 shutdown_connections 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.989+0000 7f70e89d66c0 1 -- 10.20.193.40:0/726582930 wait complete. 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e89d66c0 1 Processor -- start 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e89d66c0 1 -- start start 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e89d66c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f70e410f060 0x7f70e40f4820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:52.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e89d66c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f70e4115270 0x7f70e4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:52.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e89d66c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e40f4e50 0x7f70e40fa120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:52.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e89d66c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f70e40f5540 con 0x7f70e40f4e50 2026-02-13T01:23:52.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e89d66c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f70e40fa660 con 0x7f70e410f060 2026-02-13T01:23:52.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e89d66c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f70e40fa820 con 0x7f70e4115270 2026-02-13T01:23:52.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e3fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e40f4e50 0x7f70e40fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:52.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e3fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e40f4e50 0x7f70e40fa120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60064/0 (socket says 10.20.193.40:60064) 2026-02-13T01:23:52.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.990+0000 7f70e3fff6c0 1 -- 10.20.193.40:0/361756410 learned_addr learned my addr 10.20.193.40:0/361756410 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:52.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e37fe6c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f70e410f060 0x7f70e40f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:52.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e2ffd6c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f70e4115270 0x7f70e4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e3fff6c0 1 -- 10.20.193.40:0/361756410 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f70e4115270 msgr2=0x7f70e4175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e3fff6c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f70e4115270 0x7f70e4175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e3fff6c0 1 -- 10.20.193.40:0/361756410 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f70e410f060 msgr2=0x7f70e40f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e3fff6c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f70e410f060 0x7f70e40f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e3fff6c0 1 -- 10.20.193.40:0/361756410 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d4009590 con 0x7f70e40f4e50 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e2ffd6c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f70e4115270 0x7f70e4175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e3fff6c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e40f4e50 0x7f70e40fa120 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70d8006ea0 tx=0x7f70d800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e0ff96c0 1 -- 10.20.193.40:0/361756410 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70d8003a30 con 0x7f70e40f4e50 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e0ff96c0 1 -- 10.20.193.40:0/361756410 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f70d8005560 con 0x7f70e40f4e50 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e0ff96c0 1 -- 10.20.193.40:0/361756410 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70d80082a0 con 0x7f70e40f4e50 2026-02-13T01:23:52.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e40fab00 con 0x7f70e40f4e50 2026-02-13T01:23:52.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.991+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e40fb290 con 0x7f70e40f4e50 2026-02-13T01:23:52.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.992+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e40fafe0 con 0x7f70e40f4e50 2026-02-13T01:23:52.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.994+0000 7f70e0ff96c0 1 -- 10.20.193.40:0/361756410 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f70d800d4d0 con 0x7f70e40f4e50 2026-02-13T01:23:52.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.996+0000 7f70e0ff96c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f70b80b56d0 0x7f70b80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:52.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.996+0000 7f70e0ff96c0 1 -- 10.20.193.40:0/361756410 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f70d80e4a90 con 0x7f70e40f4e50 2026-02-13T01:23:52.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.996+0000 7f70e0ff96c0 1 -- 10.20.193.40:0/361756410 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f70d811d5e0 con 0x7f70e40f4e50 2026-02-13T01:23:52.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.996+0000 7f70e37fe6c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f70b80b56d0 0x7f70b80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:52.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:52.996+0000 7f70e37fe6c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f70b80b56d0 0x7f70b80d5b80 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70d0005980 tx=0x7f70d0005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:53.122 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:53.121+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f70e4110330 con 0x7f70e40f4e50 2026-02-13T01:23:53.123 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:53 trial040 ceph-mon[23046]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T01:23:53.123 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:53 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.55:6838/316274596,v1:10.20.193.55:6839/316274596] up:active 2026-02-13T01:23:53.123 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:53 trial040 ceph-mon[23046]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:53.123 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:53 trial040 ceph-mon[23046]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:53.123 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:53 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1648422633' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:23:53.123 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:53 trial040 ceph-mon[23046]: pgmap v176: 97 pgs: 6 creating+peering, 51 unknown, 40 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:53 trial055 ceph-mon[27509]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T01:23:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:53 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.55:6838/316274596,v1:10.20.193.55:6839/316274596] up:active 2026-02-13T01:23:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:53 trial055 ceph-mon[27509]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:53 trial055 ceph-mon[27509]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:53 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1648422633' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:23:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:53 trial055 ceph-mon[27509]: pgmap v176: 97 pgs: 6 creating+peering, 51 unknown, 40 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:53.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:53 trial118 ceph-mon[27812]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T01:23:53.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:53 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.55:6838/316274596,v1:10.20.193.55:6839/316274596] up:active 2026-02-13T01:23:53.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:53 trial118 ceph-mon[27812]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:53.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:53 trial118 ceph-mon[27812]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:53.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:53 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1648422633' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:23:53.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:53 trial118 ceph-mon[27812]: pgmap v176: 97 pgs: 6 creating+peering, 51 unknown, 40 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:23:54.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.084+0000 7f70e0ff96c0 1 -- 10.20.193.40:0/361756410 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f70d80a7540 con 0x7f70e40f4e50 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f70b80b56d0 msgr2=0x7f70b80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f70b80b56d0 0x7f70b80d5b80 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70d0005980 tx=0x7f70d0005910 comp rx=0 tx=0).stop 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e40f4e50 msgr2=0x7f70e40fa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e40f4e50 0x7f70e40fa120 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70d8006ea0 tx=0x7f70d800cca0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 shutdown_connections 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f70b80b56d0 0x7f70b80d5b80 unknown :-1 s=CLOSED pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f70e40f4e50 0x7f70e40fa120 unknown :-1 s=CLOSED pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f70e4115270 0x7f70e4175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 --2- 10.20.193.40:0/361756410 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f70e410f060 0x7f70e40f4820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 >> 10.20.193.40:0/361756410 conn(0x7f70e40ec980 msgr2=0x7f70e4111850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:54.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 shutdown_connections 2026-02-13T01:23:54.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.087+0000 7f70e89d66c0 1 -- 10.20.193.40:0/361756410 wait complete. 2026-02-13T01:23:54.197 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2026-02-13T01:23:54.197 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs set cephfs max_mds 3 --yes-i-really-mean-it 2026-02-13T01:23:54.379 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:54.420 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:54 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/361756410' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T01:23:54.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:54 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/361756410' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T01:23:54.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:54 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/361756410' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T01:23:54.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.564+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/1361717150 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 msgr2=0x7fd4d0061110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:54.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.564+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/1361717150 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 0x7fd4d0061110 secure :-1 s=READY pgs=183 gs=2 cs=0 l=1 c_cookie=4116762605671550994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4c0009970 tx=0x7fd4c002ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:54.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.564+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/1361717150 shutdown_connections 2026-02-13T01:23:54.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.564+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/1361717150 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4d0159910 0x7fd4d0179cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.564+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/1361717150 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 0x7fd4d0061110 unknown :-1 s=CLOSED pgs=183 gs=2 cs=0 l=1 c_cookie=4116762605671550994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.564+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/1361717150 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4d00622d0 0x7fd4d00607a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.564+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/1361717150 >> 10.20.193.40:0/1361717150 conn(0x7fd4d00ea6d0 msgr2=0x7fd4d010aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:54.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.564+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/1361717150 shutdown_connections 2026-02-13T01:23:54.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.564+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/1361717150 wait complete. 2026-02-13T01:23:54.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4d51f46c0 1 Processor -- start 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4d51f46c0 1 -- start start 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4d51f46c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 0x7fd4d00f1f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4d51f46c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4d00622d0 0x7fd4d00f24c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4d51f46c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4d0159910 0x7fd4d00f7880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4d51f46c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d00f7ed0 con 0x7fd4d0060ce0 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4d51f46c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d00f8040 con 0x7fd4d00622d0 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4d51f46c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d00f8200 con 0x7fd4d0159910 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4cffff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 0x7fd4d00f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4cffff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 0x7fd4d00f1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60074/0 (socket says 10.20.193.40:60074) 2026-02-13T01:23:54.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4cffff6c0 1 -- 10.20.193.40:0/4178292419 learned_addr learned my addr 10.20.193.40:0/4178292419 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.565+0000 7fd4d49f36c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4d0159910 0x7fd4d00f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cf7fe6c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4d00622d0 0x7fd4d00f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cffff6c0 1 -- 10.20.193.40:0/4178292419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4d0159910 msgr2=0x7fd4d00f7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cffff6c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4d0159910 0x7fd4d00f7880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cffff6c0 1 -- 10.20.193.40:0/4178292419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4d00622d0 msgr2=0x7fd4d00f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cffff6c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4d00622d0 0x7fd4d00f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cffff6c0 1 -- 10.20.193.40:0/4178292419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c0009590 con 0x7fd4d0060ce0 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cffff6c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 0x7fd4d00f1f80 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4bc009490 tx=0x7fd4bc00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cd7fa6c0 1 -- 10.20.193.40:0/4178292419 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4bc004a80 con 0x7fd4d0060ce0 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cd7fa6c0 1 -- 10.20.193.40:0/4178292419 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd4bc009030 con 0x7fd4d0060ce0 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4cd7fa6c0 1 -- 10.20.193.40:0/4178292419 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4bc0071c0 con 0x7fd4d0060ce0 2026-02-13T01:23:54.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d00f84e0 con 0x7fd4d0060ce0 2026-02-13T01:23:54.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.566+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d00f8ba0 con 0x7fd4d0060ce0 2026-02-13T01:23:54.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.567+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d0061cb0 con 0x7fd4d0060ce0 2026-02-13T01:23:54.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.569+0000 7fd4cd7fa6c0 1 -- 10.20.193.40:0/4178292419 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fd4bc004e90 con 0x7fd4d0060ce0 2026-02-13T01:23:54.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.571+0000 7fd4cd7fa6c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4a40b56d0 0x7fd4a40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:54.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.571+0000 7fd4cd7fa6c0 1 -- 10.20.193.40:0/4178292419 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fd4bc0e39b0 con 0x7fd4d0060ce0 2026-02-13T01:23:54.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.571+0000 7fd4cf7fe6c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4a40b56d0 0x7fd4a40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:54.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.571+0000 7fd4cd7fa6c0 1 -- 10.20.193.40:0/4178292419 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd4bc0e3e30 con 0x7fd4d0060ce0 2026-02-13T01:23:54.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.572+0000 7fd4cf7fe6c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4a40b56d0 0x7fd4a40d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4d00f8910 tx=0x7fd4c00023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:54.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:54.697+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} v 0) -- 0x7fd4d0060750 con 0x7fd4d0060ce0 2026-02-13T01:23:55.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.090+0000 7fd4cd7fa6c0 1 -- 10.20.193.40:0/4178292419 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]=0 v17) ==== 135+0+0 (secure 0 0 0) 0x7fd4bc0a6460 con 0x7fd4d0060ce0 2026-02-13T01:23:55.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.092+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4a40b56d0 msgr2=0x7fd4a40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.092+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4a40b56d0 0x7fd4a40d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4d00f8910 tx=0x7fd4c00023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.092+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 msgr2=0x7fd4d00f1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.092+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 0x7fd4d00f1f80 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4bc009490 tx=0x7fd4bc00bc50 comp rx=0 tx=0).stop 2026-02-13T01:23:55.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.093+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 shutdown_connections 2026-02-13T01:23:55.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.093+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4a40b56d0 0x7fd4a40d5b80 unknown :-1 s=CLOSED pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.093+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4d0159910 0x7fd4d00f7880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.093+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4d00622d0 0x7fd4d00f24c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.093+0000 7fd4d51f46c0 1 --2- 10.20.193.40:0/4178292419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4d0060ce0 0x7fd4d00f1f80 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.093+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 >> 10.20.193.40:0/4178292419 conn(0x7fd4d00ea6d0 msgr2=0x7fd4d010d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:55.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.093+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 shutdown_connections 2026-02-13T01:23:55.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.093+0000 7fd4d51f46c0 1 -- 10.20.193.40:0/4178292419 wait complete. 2026-02-13T01:23:55.196 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-13T01:23:55.379 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:55.425 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:55 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/361756410' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T01:23:55.425 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:55 trial040 ceph-mon[23046]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:55.425 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:55 trial040 ceph-mon[23046]: pgmap v177: 97 pgs: 6 creating+peering, 8 unknown, 83 active+clean; 578 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s wr, 8 op/s 2026-02-13T01:23:55.426 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:55 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4178292419' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:55.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:55 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/361756410' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T01:23:55.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:55 trial055 ceph-mon[27509]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:55.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:55 trial055 ceph-mon[27509]: pgmap v177: 97 pgs: 6 creating+peering, 8 unknown, 83 active+clean; 578 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s wr, 8 op/s 2026-02-13T01:23:55.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:55 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4178292419' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:55.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:55 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/361756410' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T01:23:55.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:55 trial118 ceph-mon[27812]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:55.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:55 trial118 ceph-mon[27812]: pgmap v177: 97 pgs: 6 creating+peering, 8 unknown, 83 active+clean; 578 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s wr, 8 op/s 2026-02-13T01:23:55.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:55 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4178292419' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:55.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 -- 10.20.193.40:0/92965370 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 msgr2=0x7f0570175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 --2- 10.20.193.40:0/92965370 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 0x7f0570175c10 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=2468203321746183903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f056c00aa70 tx=0x7f056c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 -- 10.20.193.40:0/92965370 shutdown_connections 2026-02-13T01:23:55.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 --2- 10.20.193.40:0/92965370 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 0x7f0570175c10 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=2468203321746183903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 --2- 10.20.193.40:0/92965370 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f057010fa50 0x7f0570114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 --2- 10.20.193.40:0/92965370 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f057010f060 0x7f057010f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 -- 10.20.193.40:0/92965370 >> 10.20.193.40:0/92965370 conn(0x7f05700ec980 msgr2=0x7f057010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:55.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 -- 10.20.193.40:0/92965370 shutdown_connections 2026-02-13T01:23:55.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 -- 10.20.193.40:0/92965370 wait complete. 2026-02-13T01:23:55.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 Processor -- start 2026-02-13T01:23:55.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.578+0000 7f057683e6c0 1 -- start start 2026-02-13T01:23:55.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057683e6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f057010f060 0x7f057011cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057683e6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 0x7f057011d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057683e6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0570122680 0x7f0570122b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057683e6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0570123090 con 0x7f0570115270 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057683e6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0570123200 con 0x7f057010f060 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057683e6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f05701233c0 con 0x7f0570122680 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057503b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 0x7f057011d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057503b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 0x7f057011d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60094/0 (socket says 10.20.193.40:60094) 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057503b6c0 1 -- 10.20.193.40:0/3952700993 learned_addr learned my addr 10.20.193.40:0/3952700993 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057583c6c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f057010f060 0x7f057011cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057603d6c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0570122680 0x7f0570122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057503b6c0 1 -- 10.20.193.40:0/3952700993 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0570122680 msgr2=0x7f0570122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057503b6c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0570122680 0x7f0570122b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057503b6c0 1 -- 10.20.193.40:0/3952700993 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f057010f060 msgr2=0x7f057011cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057503b6c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f057010f060 0x7f057011cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057503b6c0 1 -- 10.20.193.40:0/3952700993 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056c00a660 con 0x7f0570115270 2026-02-13T01:23:55.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.579+0000 7f057503b6c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 0x7f057011d2c0 secure :-1 s=READY pgs=186 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f056400b800 tx=0x7f056400bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:55.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.580+0000 7f055effd6c0 1 -- 10.20.193.40:0/3952700993 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0564004a80 con 0x7f0570115270 2026-02-13T01:23:55.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.580+0000 7f055effd6c0 1 -- 10.20.193.40:0/3952700993 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0564009070 con 0x7f0570115270 2026-02-13T01:23:55.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.580+0000 7f055effd6c0 1 -- 10.20.193.40:0/3952700993 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05640071c0 con 0x7f0570115270 2026-02-13T01:23:55.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.580+0000 7f057683e6c0 1 -- 10.20.193.40:0/3952700993 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0570163870 con 0x7f0570115270 2026-02-13T01:23:55.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.580+0000 7f057683e6c0 1 -- 10.20.193.40:0/3952700993 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0570163d00 con 0x7f0570115270 2026-02-13T01:23:55.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.580+0000 7f055cff96c0 1 -- 10.20.193.40:0/3952700993 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0570110330 con 0x7f0570115270 2026-02-13T01:23:55.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.582+0000 7f055effd6c0 1 -- 10.20.193.40:0/3952700993 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0564005000 con 0x7f0570115270 2026-02-13T01:23:55.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.584+0000 7f055effd6c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f054c0b56d0 0x7f054c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.586 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.584+0000 7f055effd6c0 1 -- 10.20.193.40:0/3952700993 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f05640e3960 con 0x7f0570115270 2026-02-13T01:23:55.586 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.585+0000 7f055effd6c0 1 -- 10.20.193.40:0/3952700993 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f05640e3de0 con 0x7f0570115270 2026-02-13T01:23:55.586 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.585+0000 7f057583c6c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f054c0b56d0 0x7f054c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.587 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.585+0000 7f057583c6c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f054c0b56d0 0x7f054c0d5b80 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0560005fd0 tx=0x7f05600093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:55.710 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:55.709+0000 7f055cff96c0 1 -- 10.20.193.40:0/3952700993 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f057011ded0 con 0x7f0570115270 2026-02-13T01:23:56.099 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.097+0000 7f055effd6c0 1 -- 10.20.193.40:0/3952700993 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f05640a6410 con 0x7f0570115270 2026-02-13T01:23:56.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.099+0000 7f055cff96c0 1 -- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f054c0b56d0 msgr2=0x7f054c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:56.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.099+0000 7f055cff96c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f054c0b56d0 0x7f054c0d5b80 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0560005fd0 tx=0x7f05600093f0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.099+0000 7f055cff96c0 1 -- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 msgr2=0x7f057011d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:56.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.099+0000 7f055cff96c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 0x7f057011d2c0 secure :-1 s=READY pgs=186 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f056400b800 tx=0x7f056400bcd0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.099+0000 7f055cff96c0 1 -- 10.20.193.40:0/3952700993 shutdown_connections 2026-02-13T01:23:56.101 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.099+0000 7f055cff96c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f054c0b56d0 0x7f054c0d5b80 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.099+0000 7f055cff96c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0570122680 0x7f0570122b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.099+0000 7f055cff96c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0570115270 0x7f057011d2c0 unknown :-1 s=CLOSED pgs=186 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.099+0000 7f055cff96c0 1 --2- 10.20.193.40:0/3952700993 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f057010f060 0x7f057011cd80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.100+0000 7f055cff96c0 1 -- 10.20.193.40:0/3952700993 >> 10.20.193.40:0/3952700993 conn(0x7f05700ec980 msgr2=0x7f057010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:56.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.100+0000 7f055cff96c0 1 -- 10.20.193.40:0/3952700993 shutdown_connections 2026-02-13T01:23:56.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.100+0000 7f055cff96c0 1 -- 10.20.193.40:0/3952700993 wait complete. 2026-02-13T01:23:56.202 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-13T01:23:56.383 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:56.424 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:56 trial040 ceph-mon[23046]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T01:23:56.425 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:56 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4178292419' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:56.425 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:56 trial040 ceph-mon[23046]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T01:23:56.425 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:56 trial040 ceph-mon[23046]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:56.425 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:56 trial040 ceph-mon[23046]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T01:23:56.425 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:56 trial040 ceph-mon[23046]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T01:23:56.425 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:56 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3952700993' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T01:23:56.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:56 trial055 ceph-mon[27509]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T01:23:56.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:56 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4178292419' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:56.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:56 trial055 ceph-mon[27509]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T01:23:56.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:56 trial055 ceph-mon[27509]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:56.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:56 trial055 ceph-mon[27509]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T01:23:56.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:56 trial055 ceph-mon[27509]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T01:23:56.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:56 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3952700993' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T01:23:56.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:56 trial118 ceph-mon[27812]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T01:23:56.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:56 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4178292419' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:56.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:56 trial118 ceph-mon[27812]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T01:23:56.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:56 trial118 ceph-mon[27812]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:23:56.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:56 trial118 ceph-mon[27812]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T01:23:56.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:56 trial118 ceph-mon[27812]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T01:23:56.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:56 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3952700993' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T01:23:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.571+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2759020787 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18cc115270 msgr2=0x7f18cc175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.571+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2759020787 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18cc115270 0x7f18cc175c10 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=6954883300141837341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18c800aa70 tx=0x7f18c802fdd0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.571+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2759020787 shutdown_connections 2026-02-13T01:23:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.571+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2759020787 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18cc115270 0x7f18cc175c10 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=6954883300141837341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.571+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2759020787 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18cc10fa50 0x7f18cc114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.571+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2759020787 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18cc10f060 0x7f18cc10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.571+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2759020787 >> 10.20.193.40:0/2759020787 conn(0x7f18cc0ec980 msgr2=0x7f18cc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.572+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2759020787 shutdown_connections 2026-02-13T01:23:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.572+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2759020787 wait complete. 2026-02-13T01:23:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d1fa36c0 1 Processor -- start 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d1fa36c0 1 -- start start 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d1fa36c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18cc10f060 0x7f18cc11cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d1fa36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18cc115270 0x7f18cc11d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d1fa36c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18cc122680 0x7f18cc122b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d1fa36c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc123090 con 0x7f18cc115270 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d1fa36c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc123200 con 0x7f18cc122680 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d1fa36c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc1233c0 con 0x7f18cc10f060 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d0fa16c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18cc10f060 0x7f18cc11cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18c3fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18cc115270 0x7f18cc11d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d0fa16c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18cc10f060 0x7f18cc11cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:54414/0 (socket says 10.20.193.40:54414) 2026-02-13T01:23:56.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d0fa16c0 1 -- 10.20.193.40:0/2264386771 learned_addr learned my addr 10.20.193.40:0/2264386771 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:56.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.573+0000 7f18d17a26c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18cc122680 0x7f18cc122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:56.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18d0fa16c0 1 -- 10.20.193.40:0/2264386771 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18cc122680 msgr2=0x7f18cc122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:56.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18d0fa16c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18cc122680 0x7f18cc122b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18d0fa16c0 1 -- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18cc115270 msgr2=0x7f18cc11d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:56.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18d0fa16c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18cc115270 0x7f18cc11d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:56.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18d0fa16c0 1 -- 10.20.193.40:0/2264386771 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c800a660 con 0x7f18cc10f060 2026-02-13T01:23:56.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18c3fff6c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18cc115270 0x7f18cc11d2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:56.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18d0fa16c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18cc10f060 0x7f18cc11cd80 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18bc005dc0 tx=0x7f18bc00bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:56.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18c1ffb6c0 1 -- 10.20.193.40:0/2264386771 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18bc004250 con 0x7f18cc10f060 2026-02-13T01:23:56.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18c1ffb6c0 1 -- 10.20.193.40:0/2264386771 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f18bc009070 con 0x7f18cc10f060 2026-02-13T01:23:56.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18c1ffb6c0 1 -- 10.20.193.40:0/2264386771 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18bc0071c0 con 0x7f18cc10f060 2026-02-13T01:23:56.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc163870 con 0x7f18cc10f060 2026-02-13T01:23:56.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.574+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc163d00 con 0x7f18cc10f060 2026-02-13T01:23:56.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.575+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc110330 con 0x7f18cc10f060 2026-02-13T01:23:56.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.577+0000 7f18c1ffb6c0 1 -- 10.20.193.40:0/2264386771 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f18bc0043b0 con 0x7f18cc10f060 2026-02-13T01:23:56.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.579+0000 7f18c1ffb6c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f18a80b5650 0x7f18a80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:56.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.579+0000 7f18c1ffb6c0 1 -- 10.20.193.40:0/2264386771 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f18bc0e3a10 con 0x7f18cc10f060 2026-02-13T01:23:56.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.579+0000 7f18c3fff6c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f18a80b5650 0x7f18a80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:56.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.579+0000 7f18c1ffb6c0 1 -- 10.20.193.40:0/2264386771 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f18bc11c5e0 con 0x7f18cc10f060 2026-02-13T01:23:56.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.579+0000 7f18c3fff6c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f18a80b5650 0x7f18a80d5b00 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18cc123710 tx=0x7f18b4009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:56.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:56.705+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f18cc10f430 con 0x7f18cc10f060 2026-02-13T01:23:56.992 INFO:journalctl@ceph.mds.b.trial055.stdout:Feb 13 01:23:56 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-b[56711]: 2026-02-13T01:23:56.619+0000 7fa309fc16c0 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-13T01:23:56.992 INFO:journalctl@ceph.mds.b.trial055.stdout:Feb 13 01:23:56 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-b[56711]: 2026-02-13T01:23:56.619+0000 7fa309fc16c0 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2026-02-13T01:23:57.106 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.105+0000 7f18c1ffb6c0 1 -- 10.20.193.40:0/2264386771 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f18bc0a64c0 con 0x7f18cc10f060 2026-02-13T01:23:57.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f18a80b5650 msgr2=0x7f18a80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:57.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f18a80b5650 0x7f18a80d5b00 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18cc123710 tx=0x7f18b4009260 comp rx=0 tx=0).stop 2026-02-13T01:23:57.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18cc10f060 msgr2=0x7f18cc11cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:57.108 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18cc10f060 0x7f18cc11cd80 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18bc005dc0 tx=0x7f18bc00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 shutdown_connections 2026-02-13T01:23:57.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f18a80b5650 0x7f18a80d5b00 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18cc122680 0x7f18cc122b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18cc115270 0x7f18cc11d2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 --2- 10.20.193.40:0/2264386771 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18cc10f060 0x7f18cc11cd80 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 >> 10.20.193.40:0/2264386771 conn(0x7f18cc0ec980 msgr2=0x7f18cc10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:57.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 shutdown_connections 2026-02-13T01:23:57.109 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.107+0000 7f18d1fa36c0 1 -- 10.20.193.40:0/2264386771 wait complete. 2026-02-13T01:23:57.210 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2026-02-13T01:23:57.210 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-13T01:23:57.392 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:57.434 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3952700993' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T01:23:57.435 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.55:6836/3322353780,v1:10.20.193.55:6837/3322353780] up:active 2026-02-13T01:23:57.435 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T01:23:57.435 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T01:23:57.435 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T01:23:57.435 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2026-02-13T01:23:57.435 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: daemon mds.i is now active in filesystem cephfs as rank 2 2026-02-13T01:23:57.435 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: pgmap v178: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s wr, 8 op/s 2026-02-13T01:23:57.435 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2264386771' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:23:57.435 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:57 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:23:57.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3952700993' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T01:23:57.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.55:6836/3322353780,v1:10.20.193.55:6837/3322353780] up:active 2026-02-13T01:23:57.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T01:23:57.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T01:23:57.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T01:23:57.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2026-02-13T01:23:57.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: daemon mds.i is now active in filesystem cephfs as rank 2 2026-02-13T01:23:57.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: pgmap v178: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s wr, 8 op/s 2026-02-13T01:23:57.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2264386771' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:23:57.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:57 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:23:57.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3952700993' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T01:23:57.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.55:6836/3322353780,v1:10.20.193.55:6837/3322353780] up:active 2026-02-13T01:23:57.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T01:23:57.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T01:23:57.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T01:23:57.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2026-02-13T01:23:57.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: daemon mds.i is now active in filesystem cephfs as rank 2 2026-02-13T01:23:57.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: pgmap v178: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s wr, 8 op/s 2026-02-13T01:23:57.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2264386771' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:23:57.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:57 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:23:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.576+0000 7f79013c86c0 1 -- 10.20.193.40:0/2897644536 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc10fbf0 msgr2=0x7f78fc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.576+0000 7f79013c86c0 1 --2- 10.20.193.40:0/2897644536 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc10fbf0 0x7f78fc114c30 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=11397964982038083791 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e40098d0 tx=0x7f78e402ec50 comp rx=0 tx=0).stop 2026-02-13T01:23:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.576+0000 7f79013c86c0 1 -- 10.20.193.40:0/2897644536 shutdown_connections 2026-02-13T01:23:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.576+0000 7f79013c86c0 1 --2- 10.20.193.40:0/2897644536 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f78fc115410 0x7f78fc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.576+0000 7f79013c86c0 1 --2- 10.20.193.40:0/2897644536 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc10fbf0 0x7f78fc114c30 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=11397964982038083791 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.576+0000 7f79013c86c0 1 --2- 10.20.193.40:0/2897644536 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f78fc10f200 0x7f78fc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.576+0000 7f79013c86c0 1 -- 10.20.193.40:0/2897644536 >> 10.20.193.40:0/2897644536 conn(0x7f78fc0ecb00 msgr2=0x7f78fc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:57.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.576+0000 7f79013c86c0 1 -- 10.20.193.40:0/2897644536 shutdown_connections 2026-02-13T01:23:57.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.576+0000 7f79013c86c0 1 -- 10.20.193.40:0/2897644536 wait complete. 2026-02-13T01:23:57.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.577+0000 7f79013c86c0 1 Processor -- start 2026-02-13T01:23:57.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.577+0000 7f79013c86c0 1 -- start start 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f79013c86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f78fc10f200 0x7f78fc180370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f79013c86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc115410 0x7f78fc17d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f79013c86c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f78fc17dcd0 0x7f78fc158cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f79013c86c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc17e3c0 con 0x7f78fc115410 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f79013c86c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc159210 con 0x7f78fc10f200 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f79013c86c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1593d0 con 0x7f78fc17dcd0 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fa7fc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc115410 0x7f78fc17d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fb7fe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f78fc17dcd0 0x7f78fc158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fa7fc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc115410 0x7f78fc17d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60124/0 (socket says 10.20.193.40:60124) 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fa7fc6c0 1 -- 10.20.193.40:0/1401196682 learned_addr learned my addr 10.20.193.40:0/1401196682 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:57.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78faffd6c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f78fc10f200 0x7f78fc180370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fa7fc6c0 1 -- 10.20.193.40:0/1401196682 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f78fc17dcd0 msgr2=0x7f78fc158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fa7fc6c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f78fc17dcd0 0x7f78fc158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fa7fc6c0 1 -- 10.20.193.40:0/1401196682 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f78fc10f200 msgr2=0x7f78fc180370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fa7fc6c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f78fc10f200 0x7f78fc180370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fa7fc6c0 1 -- 10.20.193.40:0/1401196682 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e40094c0 con 0x7f78fc115410 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78fa7fc6c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc115410 0x7f78fc17d5e0 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e40023a0 tx=0x7f78e4005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78dbfff6c0 1 -- 10.20.193.40:0/1401196682 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78e40026b0 con 0x7f78fc115410 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78dbfff6c0 1 -- 10.20.193.40:0/1401196682 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f78e40077d0 con 0x7f78fc115410 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78fc159650 con 0x7f78fc115410 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.578+0000 7f78dbfff6c0 1 -- 10.20.193.40:0/1401196682 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78e40379b0 con 0x7f78fc115410 2026-02-13T01:23:57.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.579+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78fc159b20 con 0x7f78fc115410 2026-02-13T01:23:57.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.579+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78fc1104d0 con 0x7f78fc115410 2026-02-13T01:23:57.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.581+0000 7f78dbfff6c0 1 -- 10.20.193.40:0/1401196682 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f78e40072a0 con 0x7f78fc115410 2026-02-13T01:23:57.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.583+0000 7f78dbfff6c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f78cc0b56d0 0x7f78cc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:57.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.583+0000 7f78dbfff6c0 1 -- 10.20.193.40:0/1401196682 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f78e4107910 con 0x7f78fc115410 2026-02-13T01:23:57.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.583+0000 7f78dbfff6c0 1 -- 10.20.193.40:0/1401196682 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f78e4107d90 con 0x7f78fc115410 2026-02-13T01:23:57.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.583+0000 7f78faffd6c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f78cc0b56d0 0x7f78cc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:57.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.583+0000 7f78faffd6c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f78cc0b56d0 0x7f78cc0d5b80 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f0005b40 tx=0x7f78f0009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:57.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.702+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f78fc17e8e0 con 0x7f78cc0b56d0 2026-02-13T01:23:57.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.722+0000 7f78dbfff6c0 1 -- 10.20.193.40:0/1401196682 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f78fc17e8e0 con 0x7f78cc0b56d0 2026-02-13T01:23:57.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f78cc0b56d0 msgr2=0x7f78cc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:57.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f78cc0b56d0 0x7f78cc0d5b80 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f0005b40 tx=0x7f78f0009310 comp rx=0 tx=0).stop 2026-02-13T01:23:57.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc115410 msgr2=0x7f78fc17d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:57.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc115410 0x7f78fc17d5e0 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e40023a0 tx=0x7f78e4005e40 comp rx=0 tx=0).stop 2026-02-13T01:23:57.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 shutdown_connections 2026-02-13T01:23:57.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f78cc0b56d0 0x7f78cc0d5b80 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f78fc17dcd0 0x7f78fc158cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f78fc115410 0x7f78fc17d5e0 unknown :-1 s=CLOSED pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 --2- 10.20.193.40:0/1401196682 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f78fc10f200 0x7f78fc180370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:57.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 >> 10.20.193.40:0/1401196682 conn(0x7f78fc0ecb00 msgr2=0x7f78fc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:57.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 shutdown_connections 2026-02-13T01:23:57.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:57.724+0000 7f79013c86c0 1 -- 10.20.193.40:0/1401196682 wait complete. 2026-02-13T01:23:57.827 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-13T01:23:57.999 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:23:57 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:23:57.712+0000 7f2fdbe606c0 -1 client.14730 error registering admin socket command: (17) File exists 2026-02-13T01:23:58.009 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:58.202 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.201+0000 7f0f020e66c0 1 -- 10.20.193.40:0/1622650184 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc115270 msgr2=0x7f0efc175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.203 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.201+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/1622650184 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc115270 0x7f0efc175c10 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=5734006413066741185 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ef800aa70 tx=0x7f0ef802fdd0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.203 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.201+0000 7f0f020e66c0 1 -- 10.20.193.40:0/1622650184 shutdown_connections 2026-02-13T01:23:58.203 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.201+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/1622650184 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc115270 0x7f0efc175c10 unknown :-1 s=CLOSED pgs=192 gs=2 cs=0 l=1 c_cookie=5734006413066741185 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.203 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.201+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/1622650184 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0efc10fa50 0x7f0efc114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.203 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.201+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/1622650184 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0efc10f060 0x7f0efc10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.203 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.201+0000 7f0f020e66c0 1 -- 10.20.193.40:0/1622650184 >> 10.20.193.40:0/1622650184 conn(0x7f0efc0ec980 msgr2=0x7f0efc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:58.203 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.201+0000 7f0f020e66c0 1 -- 10.20.193.40:0/1622650184 shutdown_connections 2026-02-13T01:23:58.203 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.201+0000 7f0f020e66c0 1 -- 10.20.193.40:0/1622650184 wait complete. 2026-02-13T01:23:58.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.202+0000 7f0f020e66c0 1 Processor -- start 2026-02-13T01:23:58.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.202+0000 7f0f020e66c0 1 -- start start 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.202+0000 7f0f020e66c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc10f060 0x7f0efc11cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.202+0000 7f0f020e66c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0efc115270 0x7f0efc11d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.202+0000 7f0f020e66c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0efc122690 0x7f0efc122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.202+0000 7f0f020e66c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc1230a0 con 0x7f0efc10f060 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.202+0000 7f0f020e66c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc123210 con 0x7f0efc115270 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.202+0000 7f0f020e66c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc1233d0 con 0x7f0efc122690 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f010e46c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc10f060 0x7f0efc11cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f010e46c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc10f060 0x7f0efc11cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60170/0 (socket says 10.20.193.40:60170) 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f010e46c0 1 -- 10.20.193.40:0/3344744474 learned_addr learned my addr 10.20.193.40:0/3344744474 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f018e56c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0efc122690 0x7f0efc122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:58.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f008e36c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0efc115270 0x7f0efc11d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f010e46c0 1 -- 10.20.193.40:0/3344744474 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0efc122690 msgr2=0x7f0efc122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f010e46c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0efc122690 0x7f0efc122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f010e46c0 1 -- 10.20.193.40:0/3344744474 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0efc115270 msgr2=0x7f0efc11d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f010e46c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0efc115270 0x7f0efc11d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f010e46c0 1 -- 10.20.193.40:0/3344744474 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef800a660 con 0x7f0efc10f060 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f010e46c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc10f060 0x7f0efc11cd90 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0eec009490 tx=0x7f0eec00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0eea7fc6c0 1 -- 10.20.193.40:0/3344744474 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0eec004a80 con 0x7f0efc10f060 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0eea7fc6c0 1 -- 10.20.193.40:0/3344744474 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0eec009030 con 0x7f0efc10f060 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0efc163880 con 0x7f0efc10f060 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0eea7fc6c0 1 -- 10.20.193.40:0/3344744474 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0eec0071c0 con 0x7f0efc10f060 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.203+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0efc163d10 con 0x7f0efc10f060 2026-02-13T01:23:58.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.204+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0efc110330 con 0x7f0efc10f060 2026-02-13T01:23:58.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.206+0000 7f0eea7fc6c0 1 -- 10.20.193.40:0/3344744474 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f0eec004e90 con 0x7f0efc10f060 2026-02-13T01:23:58.209 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.207+0000 7f0eea7fc6c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ed80b5760 0x7f0ed80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:58.209 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.207+0000 7f0eea7fc6c0 1 -- 10.20.193.40:0/3344744474 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f0eec0e3bb0 con 0x7f0efc10f060 2026-02-13T01:23:58.209 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.208+0000 7f0f008e36c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ed80b5760 0x7f0ed80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:58.209 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.208+0000 7f0eea7fc6c0 1 -- 10.20.193.40:0/3344744474 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0eec11c620 con 0x7f0efc10f060 2026-02-13T01:23:58.209 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.208+0000 7f0f008e36c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ed80b5760 0x7f0ed80d5c10 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0efc123720 tx=0x7f0ef0009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:58.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.325+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0efc11df10 con 0x7f0ed80b5760 2026-02-13T01:23:58.327 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:58 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T01:23:58.327 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:58 trial040 ceph-mon[23046]: mds.? [v2:10.20.193.118:6838/154749702,v1:10.20.193.118:6839/154749702] up:active 2026-02-13T01:23:58.327 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:58 trial040 ceph-mon[23046]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2026-02-13T01:23:58.327 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:58 trial040 ceph-mon[23046]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T01:23:58.327 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:58 trial040 ceph-mon[23046]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:58.341 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.339+0000 7f0eea7fc6c0 1 -- 10.20.193.40:0/3344744474 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0efc11df10 con 0x7f0ed80b5760 2026-02-13T01:23:58.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ed80b5760 msgr2=0x7f0ed80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ed80b5760 0x7f0ed80d5c10 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0efc123720 tx=0x7f0ef0009260 comp rx=0 tx=0).stop 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc10f060 msgr2=0x7f0efc11cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc10f060 0x7f0efc11cd90 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0eec009490 tx=0x7f0eec00bc50 comp rx=0 tx=0).stop 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 shutdown_connections 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ed80b5760 0x7f0ed80d5c10 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0efc122690 0x7f0efc122b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0efc115270 0x7f0efc11d2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 --2- 10.20.193.40:0/3344744474 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0efc10f060 0x7f0efc11cd90 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 >> 10.20.193.40:0/3344744474 conn(0x7f0efc0ec980 msgr2=0x7f0efc10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 shutdown_connections 2026-02-13T01:23:58.343 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.341+0000 7f0f020e66c0 1 -- 10.20.193.40:0/3344744474 wait complete. 2026-02-13T01:23:58.448 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-13T01:23:58.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:58 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T01:23:58.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:58 trial055 ceph-mon[27509]: mds.? [v2:10.20.193.118:6838/154749702,v1:10.20.193.118:6839/154749702] up:active 2026-02-13T01:23:58.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:58 trial055 ceph-mon[27509]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2026-02-13T01:23:58.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:58 trial055 ceph-mon[27509]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T01:23:58.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:58 trial055 ceph-mon[27509]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:58.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:58 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T01:23:58.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:58 trial118 ceph-mon[27812]: mds.? [v2:10.20.193.118:6838/154749702,v1:10.20.193.118:6839/154749702] up:active 2026-02-13T01:23:58.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:58 trial118 ceph-mon[27812]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2026-02-13T01:23:58.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:58 trial118 ceph-mon[27812]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T01:23:58.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:58 trial118 ceph-mon[27812]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:58.634 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:58.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.833+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/2620086677 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b581146d0 msgr2=0x7f2b5815bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.833+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/2620086677 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b581146d0 0x7f2b5815bab0 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=16974067909449006768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b48009970 tx=0x7f2b4802ed10 comp rx=0 tx=0).stop 2026-02-13T01:23:58.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.833+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/2620086677 shutdown_connections 2026-02-13T01:23:58.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.833+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/2620086677 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2b5815bff0 0x7f2b5817c3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.833+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/2620086677 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b581146d0 0x7f2b5815bab0 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=16974067909449006768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.833+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/2620086677 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2b58113dc0 0x7f2b58114190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.833+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/2620086677 >> 10.20.193.40:0/2620086677 conn(0x7f2b58058a50 msgr2=0x7f2b58058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:58.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.833+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/2620086677 shutdown_connections 2026-02-13T01:23:58.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.834+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/2620086677 wait complete. 2026-02-13T01:23:58.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.834+0000 7f2b5dfe86c0 1 Processor -- start 2026-02-13T01:23:58.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.834+0000 7f2b5dfe86c0 1 -- start start 2026-02-13T01:23:58.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b5dfe86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b58113dc0 0x7f2b58104120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b5dfe86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2b581146d0 0x7f2b58104660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b5dfe86c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2b5815bff0 0x7f2b58109a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b5dfe86c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5810a070 con 0x7f2b58113dc0 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b5dfe86c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5810a1e0 con 0x7f2b581146d0 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b5dfe86c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5810a3a0 con 0x7f2b5815bff0 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b577fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b58113dc0 0x7f2b58104120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b56ffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2b581146d0 0x7f2b58104660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b577fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b58113dc0 0x7f2b58104120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60188/0 (socket says 10.20.193.40:60188) 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b577fe6c0 1 -- 10.20.193.40:0/3192627419 learned_addr learned my addr 10.20.193.40:0/3192627419 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:58.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b57fff6c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2b5815bff0 0x7f2b58109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b577fe6c0 1 -- 10.20.193.40:0/3192627419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2b5815bff0 msgr2=0x7f2b58109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b577fe6c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2b5815bff0 0x7f2b58109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b577fe6c0 1 -- 10.20.193.40:0/3192627419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2b581146d0 msgr2=0x7f2b58104660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b577fe6c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2b581146d0 0x7f2b58104660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b577fe6c0 1 -- 10.20.193.40:0/3192627419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b48009590 con 0x7f2b58113dc0 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b57fff6c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2b5815bff0 0x7f2b58109a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b577fe6c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b58113dc0 0x7f2b58104120 secure :-1 s=READY pgs=195 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b44009490 tx=0x7f2b4400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b54ff96c0 1 -- 10.20.193.40:0/3192627419 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b44004a80 con 0x7f2b58113dc0 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b54ff96c0 1 -- 10.20.193.40:0/3192627419 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2b44009030 con 0x7f2b58113dc0 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b54ff96c0 1 -- 10.20.193.40:0/3192627419 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b440071c0 con 0x7f2b58113dc0 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5810a680 con 0x7f2b58113dc0 2026-02-13T01:23:58.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.835+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b58155990 con 0x7f2b58113dc0 2026-02-13T01:23:58.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.836+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5805b000 con 0x7f2b58113dc0 2026-02-13T01:23:58.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.838+0000 7f2b54ff96c0 1 -- 10.20.193.40:0/3192627419 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f2b44004060 con 0x7f2b58113dc0 2026-02-13T01:23:58.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.840+0000 7f2b54ff96c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2b2c0b5760 0x7f2b2c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:58.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.840+0000 7f2b54ff96c0 1 -- 10.20.193.40:0/3192627419 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f2b440e3d00 con 0x7f2b58113dc0 2026-02-13T01:23:58.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.840+0000 7f2b56ffd6c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2b2c0b5760 0x7f2b2c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:58.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.840+0000 7f2b54ff96c0 1 -- 10.20.193.40:0/3192627419 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2b440e4180 con 0x7f2b58113dc0 2026-02-13T01:23:58.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.840+0000 7f2b56ffd6c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2b2c0b5760 0x7f2b2c0d5c10 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b480023e0 tx=0x7f2b480071c0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:58.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.960+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f2b58105270 con 0x7f2b2c0b5760 2026-02-13T01:23:58.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.963+0000 7f2b54ff96c0 1 -- 10.20.193.40:0/3192627419 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2b58105270 con 0x7f2b2c0b5760 2026-02-13T01:23:58.965 INFO:teuthology.orchestra.run.trial040.stdout:/volumes/qa/sv_0/6b0187a8-8600-4c1a-99f9-6a0baa4a74b6 2026-02-13T01:23:58.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2b2c0b5760 msgr2=0x7f2b2c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2b2c0b5760 0x7f2b2c0d5c10 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b480023e0 tx=0x7f2b480071c0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b58113dc0 msgr2=0x7f2b58104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:58.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b58113dc0 0x7f2b58104120 secure :-1 s=READY pgs=195 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b44009490 tx=0x7f2b4400bca0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 shutdown_connections 2026-02-13T01:23:58.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2b2c0b5760 0x7f2b2c0d5c10 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2b5815bff0 0x7f2b58109a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2b581146d0 0x7f2b58104660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 --2- 10.20.193.40:0/3192627419 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2b58113dc0 0x7f2b58104120 unknown :-1 s=CLOSED pgs=195 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:58.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 >> 10.20.193.40:0/3192627419 conn(0x7f2b58058a50 msgr2=0x7f2b580fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:58.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 shutdown_connections 2026-02-13T01:23:58.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:58.964+0000 7f2b5dfe86c0 1 -- 10.20.193.40:0/3192627419 wait complete. 2026-02-13T01:23:59.103 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-13T01:23:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:59 trial040 ceph-mon[23046]: mgrmap e16: x(active, since 2m), standbys: z, y 2026-02-13T01:23:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:59 trial040 ceph-mon[23046]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:23:59 trial040 ceph-mon[23046]: pgmap v179: 97 pgs: 97 active+clean; 588 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 1.6 KiB/s rd, 4.6 KiB/s wr, 14 op/s 2026-02-13T01:23:59.288 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:23:59.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.485+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/1168633715 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b7810f200 msgr2=0x7f3b7810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:59.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.485+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/1168633715 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b7810f200 0x7f3b7810f5d0 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=5431540876367742950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b640099a0 tx=0x7f3b6402ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:59.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.485+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/1168633715 shutdown_connections 2026-02-13T01:23:59.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.485+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/1168633715 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b78115410 0x7f3b78175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:59.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.485+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/1168633715 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b7810fbf0 0x7f3b78114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:59.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.485+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/1168633715 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b7810f200 0x7f3b7810f5d0 unknown :-1 s=CLOSED pgs=196 gs=1 cs=0 l=1 c_cookie=5431540876367742950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:59.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.485+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/1168633715 >> 10.20.193.40:0/1168633715 conn(0x7f3b780ecb00 msgr2=0x7f3b7810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:59.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.485+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/1168633715 shutdown_connections 2026-02-13T01:23:59.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.485+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/1168633715 wait complete. 2026-02-13T01:23:59.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.486+0000 7f3b7e7df6c0 1 Processor -- start 2026-02-13T01:23:59.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.486+0000 7f3b7e7df6c0 1 -- start start 2026-02-13T01:23:59.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.486+0000 7f3b7e7df6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b7810f200 0x7f3b7811cff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:59.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.486+0000 7f3b7e7df6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b78115410 0x7f3b7811d530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:59.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.486+0000 7f3b7e7df6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b781228f0 0x7f3b78122d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:59.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.486+0000 7f3b7e7df6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78123300 con 0x7f3b781228f0 2026-02-13T01:23:59.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.486+0000 7f3b7e7df6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78123470 con 0x7f3b7810f200 2026-02-13T01:23:59.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.486+0000 7f3b7e7df6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78123630 con 0x7f3b78115410 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b77fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b7810f200 0x7f3b7811cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b77fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b7810f200 0x7f3b7811cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:52046/0 (socket says 10.20.193.40:52046) 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b77fff6c0 1 -- 10.20.193.40:0/3138153031 learned_addr learned my addr 10.20.193.40:0/3138153031 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b7cd516c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b781228f0 0x7f3b78122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b777fe6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b78115410 0x7f3b7811d530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b77fff6c0 1 -- 10.20.193.40:0/3138153031 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b78115410 msgr2=0x7f3b7811d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b77fff6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b78115410 0x7f3b7811d530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b77fff6c0 1 -- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b781228f0 msgr2=0x7f3b78122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b77fff6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b781228f0 0x7f3b78122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b77fff6c0 1 -- 10.20.193.40:0/3138153031 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c00a5b0 con 0x7f3b7810f200 2026-02-13T01:23:59.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b77fff6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b7810f200 0x7f3b7811cff0 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b640098c0 tx=0x7f3b6402f820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:59.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b757fa6c0 1 -- 10.20.193.40:0/3138153031 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b640046b0 con 0x7f3b7810f200 2026-02-13T01:23:59.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b757fa6c0 1 -- 10.20.193.40:0/3138153031 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3b64005e70 con 0x7f3b7810f200 2026-02-13T01:23:59.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b757fa6c0 1 -- 10.20.193.40:0/3138153031 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b640073f0 con 0x7f3b7810f200 2026-02-13T01:23:59.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b64009590 con 0x7f3b7810f200 2026-02-13T01:23:59.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.487+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b78163cf0 con 0x7f3b7810f200 2026-02-13T01:23:59.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.488+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b781104d0 con 0x7f3b7810f200 2026-02-13T01:23:59.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:59 trial055 ceph-mon[27509]: mgrmap e16: x(active, since 2m), standbys: z, y 2026-02-13T01:23:59.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:59 trial055 ceph-mon[27509]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:59.493 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:23:59 trial055 ceph-mon[27509]: pgmap v179: 97 pgs: 97 active+clean; 588 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 1.6 KiB/s rd, 4.6 KiB/s wr, 14 op/s 2026-02-13T01:23:59.493 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.490+0000 7f3b757fa6c0 1 -- 10.20.193.40:0/3138153031 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f3b64031150 con 0x7f3b7810f200 2026-02-13T01:23:59.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.492+0000 7f3b757fa6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3b4c0b56e0 0x7f3b4c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:59.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.492+0000 7f3b757fa6c0 1 -- 10.20.193.40:0/3138153031 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f3b64107e00 con 0x7f3b7810f200 2026-02-13T01:23:59.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.492+0000 7f3b777fe6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3b4c0b56e0 0x7f3b4c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:59.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.492+0000 7f3b757fa6c0 1 -- 10.20.193.40:0/3138153031 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3b64108280 con 0x7f3b7810f200 2026-02-13T01:23:59.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.492+0000 7f3b777fe6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3b4c0b56e0 0x7f3b4c0d5b90 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b78123980 tx=0x7f3b68009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:59.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:59 trial118 ceph-mon[27812]: mgrmap e16: x(active, since 2m), standbys: z, y 2026-02-13T01:23:59.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:59 trial118 ceph-mon[27812]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:59.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:23:59 trial118 ceph-mon[27812]: pgmap v179: 97 pgs: 97 active+clean; 588 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 1.6 KiB/s rd, 4.6 KiB/s wr, 14 op/s 2026-02-13T01:23:59.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.612+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3b7811e140 con 0x7f3b4c0b56e0 2026-02-13T01:23:59.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.628+0000 7f3b757fa6c0 1 -- 10.20.193.40:0/3138153031 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3b7811e140 con 0x7f3b4c0b56e0 2026-02-13T01:23:59.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3b4c0b56e0 msgr2=0x7f3b4c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3b4c0b56e0 0x7f3b4c0d5b90 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b78123980 tx=0x7f3b68009260 comp rx=0 tx=0).stop 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b7810f200 msgr2=0x7f3b7811cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b7810f200 0x7f3b7811cff0 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b640098c0 tx=0x7f3b6402f820 comp rx=0 tx=0).stop 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 shutdown_connections 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3b4c0b56e0 0x7f3b4c0d5b90 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3b781228f0 0x7f3b78122d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3b78115410 0x7f3b7811d530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 --2- 10.20.193.40:0/3138153031 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3b7810f200 0x7f3b7811cff0 unknown :-1 s=CLOSED pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 >> 10.20.193.40:0/3138153031 conn(0x7f3b780ecb00 msgr2=0x7f3b7810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 shutdown_connections 2026-02-13T01:23:59.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:23:59.629+0000 7f3b7e7df6c0 1 -- 10.20.193.40:0/3138153031 wait complete. 2026-02-13T01:23:59.734 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-13T01:23:59.919 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:00.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.124+0000 7f014e1ca6c0 1 -- 10.20.193.40:0/2106389822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f014810b170 msgr2=0x7f014810b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.124+0000 7f014e1ca6c0 1 --2- 10.20.193.40:0/2106389822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f014810b170 0x7f014810b540 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=752922601059801957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01380099a0 tx=0x7f013802ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:00.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.124+0000 7f014e1ca6c0 1 -- 10.20.193.40:0/2106389822 shutdown_connections 2026-02-13T01:24:00.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.124+0000 7f014e1ca6c0 1 --2- 10.20.193.40:0/2106389822 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0148112fe0 0x7f0148173980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.124+0000 7f014e1ca6c0 1 --2- 10.20.193.40:0/2106389822 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f014810bb60 0x7f0148112800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.124+0000 7f014e1ca6c0 1 --2- 10.20.193.40:0/2106389822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f014810b170 0x7f014810b540 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=752922601059801957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.124+0000 7f014e1ca6c0 1 -- 10.20.193.40:0/2106389822 >> 10.20.193.40:0/2106389822 conn(0x7f0148063d50 msgr2=0x7f0148109470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:00.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.124+0000 7f014e1ca6c0 1 -- 10.20.193.40:0/2106389822 shutdown_connections 2026-02-13T01:24:00.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.124+0000 7f014e1ca6c0 1 -- 10.20.193.40:0/2106389822 wait complete. 2026-02-13T01:24:00.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014e1ca6c0 1 Processor -- start 2026-02-13T01:24:00.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014e1ca6c0 1 -- start start 2026-02-13T01:24:00.129 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014e1ca6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f014810b170 0x7f014811ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:00.129 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014e1ca6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0148112fe0 0x7f014811b170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:00.129 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014e1ca6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0148120490 0x7f0148120930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:00.129 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014e1ca6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0148120ea0 con 0x7f0148120490 2026-02-13T01:24:00.129 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014e1ca6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0148121010 con 0x7f0148112fe0 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014e1ca6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f01481211d0 con 0x7f014810b170 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014d9c96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0148120490 0x7f0148120930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014d9c96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0148120490 0x7f0148120930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33354/0 (socket says 10.20.193.40:33354) 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014d9c96c0 1 -- 10.20.193.40:0/1308758240 learned_addr learned my addr 10.20.193.40:0/1308758240 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014c9c76c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0148112fe0 0x7f014811b170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.125+0000 7f014d1c86c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f014810b170 0x7f014811ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f014d9c96c0 1 -- 10.20.193.40:0/1308758240 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f014810b170 msgr2=0x7f014811ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f014d9c96c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f014810b170 0x7f014811ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f014d9c96c0 1 -- 10.20.193.40:0/1308758240 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0148112fe0 msgr2=0x7f014811b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f014d9c96c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0148112fe0 0x7f014811b170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f014d9c96c0 1 -- 10.20.193.40:0/1308758240 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0138009590 con 0x7f0148120490 2026-02-13T01:24:00.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f014d9c96c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0148120490 0x7f0148120930 secure :-1 s=READY pgs=198 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0144006ea0 tx=0x7f014400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:00.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f01367fc6c0 1 -- 10.20.193.40:0/1308758240 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0144003c40 con 0x7f0148120490 2026-02-13T01:24:00.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f014e1ca6c0 1 -- 10.20.193.40:0/1308758240 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0148161680 con 0x7f0148120490 2026-02-13T01:24:00.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f014e1ca6c0 1 -- 10.20.193.40:0/1308758240 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0148161b60 con 0x7f0148120490 2026-02-13T01:24:00.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f01367fc6c0 1 -- 10.20.193.40:0/1308758240 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0144003da0 con 0x7f0148120490 2026-02-13T01:24:00.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.126+0000 7f01367fc6c0 1 -- 10.20.193.40:0/1308758240 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0144008440 con 0x7f0148120490 2026-02-13T01:24:00.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.127+0000 7f0117fff6c0 1 -- 10.20.193.40:0/1308758240 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f014805f220 con 0x7f0148120490 2026-02-13T01:24:00.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.129+0000 7f01367fc6c0 1 -- 10.20.193.40:0/1308758240 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f014400d740 con 0x7f0148120490 2026-02-13T01:24:00.132 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.131+0000 7f01367fc6c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01240b5760 0x7f01240d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:00.132 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.131+0000 7f01367fc6c0 1 -- 10.20.193.40:0/1308758240 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f01440e4d30 con 0x7f0148120490 2026-02-13T01:24:00.132 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.131+0000 7f014d1c86c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01240b5760 0x7f01240d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:00.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.131+0000 7f01367fc6c0 1 -- 10.20.193.40:0/1308758240 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f01440e51b0 con 0x7f0148120490 2026-02-13T01:24:00.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.132+0000 7f014d1c86c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01240b5760 0x7f01240d5c10 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01380023e0 tx=0x7f01380071c0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:00.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:00 trial040 ceph-mon[23046]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:00.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:00 trial040 ceph-mon[23046]: from='client.24797 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:00.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.252+0000 7f0117fff6c0 1 -- 10.20.193.40:0/1308758240 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f014811bce0 con 0x7f01240b5760 2026-02-13T01:24:00.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.255+0000 7f01367fc6c0 1 -- 10.20.193.40:0/1308758240 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f014811bce0 con 0x7f01240b5760 2026-02-13T01:24:00.257 INFO:teuthology.orchestra.run.trial040.stdout:/volumes/qa/sv_1/91abe5d4-2316-446f-bbfe-8a869626077b 2026-02-13T01:24:00.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.256+0000 7f0117fff6c0 1 -- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01240b5760 msgr2=0x7f01240d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.256+0000 7f0117fff6c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01240b5760 0x7f01240d5c10 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01380023e0 tx=0x7f01380071c0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.256+0000 7f0117fff6c0 1 -- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0148120490 msgr2=0x7f0148120930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.256+0000 7f0117fff6c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0148120490 0x7f0148120930 secure :-1 s=READY pgs=198 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0144006ea0 tx=0x7f014400ce50 comp rx=0 tx=0).stop 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.257+0000 7f0117fff6c0 1 -- 10.20.193.40:0/1308758240 shutdown_connections 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.257+0000 7f0117fff6c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01240b5760 0x7f01240d5c10 unknown :-1 s=CLOSED pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.257+0000 7f0117fff6c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0148120490 0x7f0148120930 unknown :-1 s=CLOSED pgs=198 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.257+0000 7f0117fff6c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0148112fe0 0x7f014811b170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.257+0000 7f0117fff6c0 1 --2- 10.20.193.40:0/1308758240 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f014810b170 0x7f014811ac30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.257+0000 7f0117fff6c0 1 -- 10.20.193.40:0/1308758240 >> 10.20.193.40:0/1308758240 conn(0x7f0148063d50 msgr2=0x7f014810e590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.257+0000 7f0117fff6c0 1 -- 10.20.193.40:0/1308758240 shutdown_connections 2026-02-13T01:24:00.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.257+0000 7f0117fff6c0 1 -- 10.20.193.40:0/1308758240 wait complete. 2026-02-13T01:24:00.395 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:24:00.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:00 trial055 ceph-mon[27509]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:00.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:00 trial055 ceph-mon[27509]: from='client.24797 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:00.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:00 trial118 ceph-mon[27812]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:00.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:00 trial118 ceph-mon[27812]: from='client.24797 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:00.581 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:00.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.785+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/3357326003 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10fa40 msgr2=0x7f3c0c114a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.785+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/3357326003 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10fa40 0x7f3c0c114a80 secure :-1 s=READY pgs=199 gs=2 cs=0 l=1 c_cookie=10617293264893105065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c000099a0 tx=0x7f3c0002ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:00.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.786+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/3357326003 shutdown_connections 2026-02-13T01:24:00.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.786+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/3357326003 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3c0c115260 0x7f3c0c175c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.786+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/3357326003 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10fa40 0x7f3c0c114a80 unknown :-1 s=CLOSED pgs=199 gs=2 cs=0 l=1 c_cookie=10617293264893105065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.786+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/3357326003 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3c0c10f050 0x7f3c0c10f420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.786+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/3357326003 >> 10.20.193.40:0/3357326003 conn(0x7f3c0c0ec950 msgr2=0x7f3c0c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:00.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.786+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/3357326003 shutdown_connections 2026-02-13T01:24:00.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.786+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/3357326003 wait complete. 2026-02-13T01:24:00.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c122fb6c0 1 Processor -- start 2026-02-13T01:24:00.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c122fb6c0 1 -- start start 2026-02-13T01:24:00.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c122fb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10f050 0x7f3c0c11ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:00.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c122fb6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3c0c115260 0x7f3c0c11d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:00.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c122fb6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3c0c122700 0x7f3c0c122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:00.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c122fb6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c123110 con 0x7f3c0c10f050 2026-02-13T01:24:00.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c122fb6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c123280 con 0x7f3c0c122700 2026-02-13T01:24:00.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c122fb6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c123440 con 0x7f3c0c115260 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c112f96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10f050 0x7f3c0c11ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c10af86c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3c0c115260 0x7f3c0c11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c112f96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10f050 0x7f3c0c11ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33362/0 (socket says 10.20.193.40:33362) 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c112f96c0 1 -- 10.20.193.40:0/259615617 learned_addr learned my addr 10.20.193.40:0/259615617 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c11afa6c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3c0c122700 0x7f3c0c122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c112f96c0 1 -- 10.20.193.40:0/259615617 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3c0c115260 msgr2=0x7f3c0c11d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c112f96c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3c0c115260 0x7f3c0c11d340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c112f96c0 1 -- 10.20.193.40:0/259615617 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3c0c122700 msgr2=0x7f3c0c122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c112f96c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3c0c122700 0x7f3c0c122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.787+0000 7f3c112f96c0 1 -- 10.20.193.40:0/259615617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c00009590 con 0x7f3c0c10f050 2026-02-13T01:24:00.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.788+0000 7f3c112f96c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10f050 0x7f3c0c11ce00 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bfc009490 tx=0x7f3bfc00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:00.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.788+0000 7f3bfa7fc6c0 1 -- 10.20.193.40:0/259615617 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bfc004a80 con 0x7f3c0c10f050 2026-02-13T01:24:00.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.788+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c1638f0 con 0x7f3c0c10f050 2026-02-13T01:24:00.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.788+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c163d80 con 0x7f3c0c10f050 2026-02-13T01:24:00.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.788+0000 7f3bfa7fc6c0 1 -- 10.20.193.40:0/259615617 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3bfc009030 con 0x7f3c0c10f050 2026-02-13T01:24:00.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.788+0000 7f3bfa7fc6c0 1 -- 10.20.193.40:0/259615617 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bfc0071c0 con 0x7f3c0c10f050 2026-02-13T01:24:00.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.788+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0c110320 con 0x7f3c0c10f050 2026-02-13T01:24:00.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.791+0000 7f3bfa7fc6c0 1 -- 10.20.193.40:0/259615617 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f3bfc004e90 con 0x7f3c0c10f050 2026-02-13T01:24:00.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.792+0000 7f3bfa7fc6c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3be80b5760 0x7f3be80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:00.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.792+0000 7f3bfa7fc6c0 1 -- 10.20.193.40:0/259615617 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f3bfc0e3bb0 con 0x7f3c0c10f050 2026-02-13T01:24:00.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.793+0000 7f3c10af86c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3be80b5760 0x7f3be80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:00.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.793+0000 7f3bfa7fc6c0 1 -- 10.20.193.40:0/259615617 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3bfc11c620 con 0x7f3c0c10f050 2026-02-13T01:24:00.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.793+0000 7f3c10af86c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3be80b5760 0x7f3be80d5c10 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c0c123790 tx=0x7f3c000023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:00.921 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.919+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c0c10f420 con 0x7f3c0c10f050 2026-02-13T01:24:00.921 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.920+0000 7f3bfa7fc6c0 1 -- 10.20.193.40:0/259615617 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11926 (secure 0 0 0) 0x7f3bfc0a6500 con 0x7f3c0c10f050 2026-02-13T01:24:00.922 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:00.922 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":22,"btime":"2026-02-13T01:23:57:106053+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6835/265154799","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6834","nonce":265154799},{"type":"v1","addr":"10.20.193.40:6835","nonce":265154799}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14625,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6837/3247182877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6836","nonce":3247182877},{"type":"v1","addr":"10.20.193.40:6837","nonce":3247182877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6839/747178723","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6838","nonce":747178723},{"type":"v1","addr":"10.20.193.40:6839","nonce":747178723}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.40:6841/800475237","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6840","nonce":800475237},{"type":"v1","addr":"10.20.193.40:6841","nonce":800475237}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24610,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.118:6833/3201305130","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6832","nonce":3201305130},{"type":"v1","addr":"10.20.193.118:6833","nonce":3201305130}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24632,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.55:6833/1911183527","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6832","nonce":1911183527},{"type":"v1","addr":"10.20.193.55:6833","nonce":1911183527}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-13T01:23:50.933421+0000","modified":"2026-02-13T01:23:57.106047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24671,"mds_2":24661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24640":{"gid":24640,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.118:6835/3508006300","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6834","nonce":3508006300},{"type":"v1","addr":"10.20.193.118:6835","nonce":3508006300}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.118:6837/3471585859","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6836","nonce":3471585859},{"type":"v1","addr":"10.20.193.118:6837","nonce":3471585859}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.55:6835/155719398","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6834","nonce":155719398},{"type":"v1","addr":"10.20.193.55:6835","nonce":155719398}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.118:6839/154749702","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6838","nonce":154749702},{"type":"v1","addr":"10.20.193.118:6839","nonce":154749702}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24671":{"gid":24671,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.55:6837/3322353780","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6836","nonce":3322353780},{"type":"v1","addr":"10.20.193.55:6837","nonce":3322353780}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"10.20.193.55:6839/316274596","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6838","nonce":316274596},{"type":"v1","addr":"10.20.193.55:6839","nonce":316274596}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24671,24661]},"id":1}]} 2026-02-13T01:24:00.923 INFO:teuthology.orchestra.run.trial040.stderr:dumped fsmap epoch 22 2026-02-13T01:24:00.923 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3be80b5760 msgr2=0x7f3be80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.923 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3be80b5760 0x7f3be80d5c10 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c0c123790 tx=0x7f3c000023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.923 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10f050 msgr2=0x7f3c0c11ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:00.923 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10f050 0x7f3c0c11ce00 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bfc009490 tx=0x7f3bfc00bc50 comp rx=0 tx=0).stop 2026-02-13T01:24:00.923 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 shutdown_connections 2026-02-13T01:24:00.923 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3be80b5760 0x7f3be80d5c10 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3c0c122700 0x7f3c0c122ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3c0c115260 0x7f3c0c11d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 --2- 10.20.193.40:0/259615617 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3c0c10f050 0x7f3c0c11ce00 unknown :-1 s=CLOSED pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:00.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 >> 10.20.193.40:0/259615617 conn(0x7f3c0c0ec950 msgr2=0x7f3c0c10cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:00.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 shutdown_connections 2026-02-13T01:24:00.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:00.921+0000 7f3c122fb6c0 1 -- 10.20.193.40:0/259615617 wait complete. 2026-02-13T01:24:01.023 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:24:01.208 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:01.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:01 trial040 ceph-mon[23046]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:01.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:01 trial040 ceph-mon[23046]: pgmap v180: 97 pgs: 97 active+clean; 589 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5.2 KiB/s wr, 17 op/s 2026-02-13T01:24:01.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:01 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/259615617' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:24:01.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.406+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1918142943 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ce010fbf0 msgr2=0x7f6ce0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:01.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.406+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1918142943 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ce010fbf0 0x7f6ce0114c30 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=14725896513460493328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd40099a0 tx=0x7f6cd402ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:01.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.406+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1918142943 shutdown_connections 2026-02-13T01:24:01.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.406+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1918142943 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ce0115410 0x7f6ce0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.406+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1918142943 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ce010fbf0 0x7f6ce0114c30 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=14725896513460493328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.406+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1918142943 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ce010f200 0x7f6ce010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.406+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1918142943 >> 10.20.193.40:0/1918142943 conn(0x7f6ce00ecb00 msgr2=0x7f6ce010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:01.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.406+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1918142943 shutdown_connections 2026-02-13T01:24:01.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.406+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1918142943 wait complete. 2026-02-13T01:24:01.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce80c96c0 1 Processor -- start 2026-02-13T01:24:01.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce80c96c0 1 -- start start 2026-02-13T01:24:01.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce80c96c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ce010f200 0x7f6ce00f49e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce80c96c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ce0115410 0x7f6ce0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce80c96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ce00f5010 0x7f6ce00fa2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce80c96c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce00f5670 con 0x7f6ce00f5010 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce80c96c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce00fa820 con 0x7f6ce0115410 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce80c96c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce00fa9e0 con 0x7f6ce010f200 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce5e3a6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ce010f200 0x7f6ce00f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce663b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ce00f5010 0x7f6ce00fa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce56396c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ce0115410 0x7f6ce0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce5e3a6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ce010f200 0x7f6ce00f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:51622/0 (socket says 10.20.193.40:51622) 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce5e3a6c0 1 -- 10.20.193.40:0/1516207064 learned_addr learned my addr 10.20.193.40:0/1516207064 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.407+0000 7f6ce56396c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ce0115410 0x7f6ce0175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33330/0 (socket says 10.20.193.40:33330) 2026-02-13T01:24:01.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6ce56396c0 1 -- 10.20.193.40:0/1516207064 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ce010f200 msgr2=0x7f6ce00f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6ce56396c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ce010f200 0x7f6ce00f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6ce56396c0 1 -- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ce00f5010 msgr2=0x7f6ce00fa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6ce56396c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ce00f5010 0x7f6ce00fa2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6ce56396c0 1 -- 10.20.193.40:0/1516207064 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd4009590 con 0x7f6ce0115410 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6ce663b6c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ce00f5010 0x7f6ce00fa2e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6ce56396c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ce0115410 0x7f6ce0175cb0 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd402f210 tx=0x7f6cd402f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6cceffd6c0 1 -- 10.20.193.40:0/1516207064 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cd40046b0 con 0x7f6ce0115410 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6cceffd6c0 1 -- 10.20.193.40:0/1516207064 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6cd4002be0 con 0x7f6ce0115410 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce00fac00 con 0x7f6ce0115410 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6cceffd6c0 1 -- 10.20.193.40:0/1516207064 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cd40073f0 con 0x7f6ce0115410 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.408+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce00fb0d0 con 0x7f6ce0115410 2026-02-13T01:24:01.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.409+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce01104d0 con 0x7f6ce0115410 2026-02-13T01:24:01.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.411+0000 7f6cceffd6c0 1 -- 10.20.193.40:0/1516207064 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f6cd40026b0 con 0x7f6ce0115410 2026-02-13T01:24:01.414 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.413+0000 7f6cceffd6c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6cbc0b5760 0x7f6cbc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:01.414 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.413+0000 7f6cceffd6c0 1 -- 10.20.193.40:0/1516207064 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f6cd4107c10 con 0x7f6ce0115410 2026-02-13T01:24:01.414 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.413+0000 7f6ce5e3a6c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6cbc0b5760 0x7f6cbc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:01.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.413+0000 7f6cceffd6c0 1 -- 10.20.193.40:0/1516207064 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6cd4108090 con 0x7f6ce0115410 2026-02-13T01:24:01.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.413+0000 7f6ce5e3a6c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6cbc0b5760 0x7f6cbc0d5c10 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd0005f90 tx=0x7f6cd0009410 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:01.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:01 trial055 ceph-mon[27509]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:01.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:01 trial055 ceph-mon[27509]: pgmap v180: 97 pgs: 97 active+clean; 589 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5.2 KiB/s wr, 17 op/s 2026-02-13T01:24:01.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:01 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/259615617' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:24:01.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:01 trial118 ceph-mon[27812]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:01.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:01 trial118 ceph-mon[27812]: pgmap v180: 97 pgs: 97 active+clean; 589 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5.2 KiB/s wr, 17 op/s 2026-02-13T01:24:01.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:01 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/259615617' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:24:01.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.514+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ce00f5b30 con 0x7f6ce0115410 2026-02-13T01:24:01.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.515+0000 7f6cceffd6c0 1 -- 10.20.193.40:0/1516207064 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22317 (secure 0 0 0) 0x7f6cd40ca560 con 0x7f6ce0115410 2026-02-13T01:24:01.517 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:01.517 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":74,"fsid":"304b456c-087a-11f1-98ea-d404e6e7d460","created":"2026-02-13T01:20:52.557389+0000","modified":"2026-02-13T01:23:52.076554+0000","last_up_change":"2026-02-13T01:23:30.097332+0000","last_in_change":"2026-02-13T01:23:21.835674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:22:12.069221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:23:48.399006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:23:49.929655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6fb8271-19fd-4149-91ec-ed412cd5dc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6803","nonce":3956883177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6805","nonce":3956883177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6809","nonce":3956883177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6807","nonce":3956883177}]},"public_addr":"10.20.193.40:6803/3956883177","cluster_addr":"10.20.193.40:6805/3956883177","heartbeat_back_addr":"10.20.193.40:6809/3956883177","heartbeat_front_addr":"10.20.193.40:6807/3956883177","state":["exists","up"]},{"osd":1,"uuid":"3d8d3277-423d-455b-af0d-67d15aaea487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6800","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6801","nonce":3110028162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6802","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6803","nonce":3110028162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6806","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6807","nonce":3110028162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6804","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6805","nonce":3110028162}]},"public_addr":"10.20.193.55:6801/3110028162","cluster_addr":"10.20.193.55:6803/3110028162","heartbeat_back_addr":"10.20.193.55:6807/3110028162","heartbeat_front_addr":"10.20.193.55:6805/3110028162","state":["exists","up"]},{"osd":2,"uuid":"9d84270b-3934-48db-99a7-d6b8845c344d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6800","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6801","nonce":2584237293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6802","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6803","nonce":2584237293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6806","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6807","nonce":2584237293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6804","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6805","nonce":2584237293}]},"public_addr":"10.20.193.118:6801/2584237293","cluster_addr":"10.20.193.118:6803/2584237293","heartbeat_back_addr":"10.20.193.118:6807/2584237293","heartbeat_front_addr":"10.20.193.118:6805/2584237293","state":["exists","up"]},{"osd":3,"uuid":"d7a9da01-a235-4069-9e09-562abc3c2ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6811","nonce":485777007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6813","nonce":485777007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6817","nonce":485777007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6815","nonce":485777007}]},"public_addr":"10.20.193.40:6811/485777007","cluster_addr":"10.20.193.40:6813/485777007","heartbeat_back_addr":"10.20.193.40:6817/485777007","heartbeat_front_addr":"10.20.193.40:6815/485777007","state":["exists","up"]},{"osd":4,"uuid":"a3a5b0ea-f758-46ce-bd6d-afaa74db16bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6808","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6809","nonce":3166522039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6810","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6811","nonce":3166522039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6814","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6815","nonce":3166522039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6812","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6813","nonce":3166522039}]},"public_addr":"10.20.193.55:6809/3166522039","cluster_addr":"10.20.193.55:6811/3166522039","heartbeat_back_addr":"10.20.193.55:6815/3166522039","heartbeat_front_addr":"10.20.193.55:6813/3166522039","state":["exists","up"]},{"osd":5,"uuid":"785971ea-187d-4818-a068-2f11a062f7f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6808","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6809","nonce":674220568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6810","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6811","nonce":674220568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6814","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6815","nonce":674220568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6812","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6813","nonce":674220568}]},"public_addr":"10.20.193.118:6809/674220568","cluster_addr":"10.20.193.118:6811/674220568","heartbeat_back_addr":"10.20.193.118:6815/674220568","heartbeat_front_addr":"10.20.193.118:6813/674220568","state":["exists","up"]},{"osd":6,"uuid":"d852201c-70dd-4be3-af89-2a49bdf1e9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6819","nonce":3706078337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6821","nonce":3706078337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6824","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6825","nonce":3706078337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6823","nonce":3706078337}]},"public_addr":"10.20.193.40:6819/3706078337","cluster_addr":"10.20.193.40:6821/3706078337","heartbeat_back_addr":"10.20.193.40:6825/3706078337","heartbeat_front_addr":"10.20.193.40:6823/3706078337","state":["exists","up"]},{"osd":7,"uuid":"55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6816","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6817","nonce":1340798625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6818","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6819","nonce":1340798625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6822","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6823","nonce":1340798625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6820","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6821","nonce":1340798625}]},"public_addr":"10.20.193.55:6817/1340798625","cluster_addr":"10.20.193.55:6819/1340798625","heartbeat_back_addr":"10.20.193.55:6823/1340798625","heartbeat_front_addr":"10.20.193.55:6821/1340798625","state":["exists","up"]},{"osd":8,"uuid":"9a727c13-2b82-4465-9c5a-af294ba75403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6816","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6817","nonce":2741939670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6818","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6819","nonce":2741939670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6822","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6823","nonce":2741939670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6820","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6821","nonce":2741939670}]},"public_addr":"10.20.193.118:6817/2741939670","cluster_addr":"10.20.193.118:6819/2741939670","heartbeat_back_addr":"10.20.193.118:6823/2741939670","heartbeat_front_addr":"10.20.193.118:6821/2741939670","state":["exists","up"]},{"osd":9,"uuid":"2e674b08-c75c-41c1-a91b-09987dfb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6827","nonce":1636530405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6828","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6829","nonce":1636530405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6832","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6833","nonce":1636530405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6831","nonce":1636530405}]},"public_addr":"10.20.193.40:6827/1636530405","cluster_addr":"10.20.193.40:6829/1636530405","heartbeat_back_addr":"10.20.193.40:6833/1636530405","heartbeat_front_addr":"10.20.193.40:6831/1636530405","state":["exists","up"]},{"osd":10,"uuid":"c0253c41-b910-4637-aae8-5c00bc814dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6824","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6825","nonce":461194356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6826","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6827","nonce":461194356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6830","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6831","nonce":461194356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6828","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6829","nonce":461194356}]},"public_addr":"10.20.193.55:6825/461194356","cluster_addr":"10.20.193.55:6827/461194356","heartbeat_back_addr":"10.20.193.55:6831/461194356","heartbeat_front_addr":"10.20.193.55:6829/461194356","state":["exists","up"]},{"osd":11,"uuid":"de7616d6-df2d-4ade-8676-6c4e95da253c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6824","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6825","nonce":1832833901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6826","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6827","nonce":1832833901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6830","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6831","nonce":1832833901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6828","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6829","nonce":1832833901}]},"public_addr":"10.20.193.118:6825/1832833901","cluster_addr":"10.20.193.118:6827/1832833901","heartbeat_back_addr":"10.20.193.118:6831/1832833901","heartbeat_front_addr":"10.20.193.118:6829/1832833901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:21:55.803128+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:03.064285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:10.128421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:20.969922+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:28.580756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:35.696627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:46.838480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:54.619455+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:02.014372+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:12.955709+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:20.865741+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:28.300625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.40:6801/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:6800/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/743801918":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1188631814":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1549127191":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/4084024233":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/2202236316":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/3369709934":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6801/2001072148":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6800/2001072148":"2026-02-14T01:21:00.614882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:24:01.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6cbc0b5760 msgr2=0x7f6cbc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:01.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6cbc0b5760 0x7f6cbc0d5c10 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd0005f90 tx=0x7f6cd0009410 comp rx=0 tx=0).stop 2026-02-13T01:24:01.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ce0115410 msgr2=0x7f6ce0175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:01.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ce0115410 0x7f6ce0175cb0 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd402f210 tx=0x7f6cd402f810 comp rx=0 tx=0).stop 2026-02-13T01:24:01.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 shutdown_connections 2026-02-13T01:24:01.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6cbc0b5760 0x7f6cbc0d5c10 unknown :-1 s=CLOSED pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ce00f5010 0x7f6ce00fa2e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6ce0115410 0x7f6ce0175cb0 unknown :-1 s=CLOSED pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 --2- 10.20.193.40:0/1516207064 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6ce010f200 0x7f6ce00f49e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.516+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 >> 10.20.193.40:0/1516207064 conn(0x7f6ce00ecb00 msgr2=0x7f6ce010d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:01.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.517+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 shutdown_connections 2026-02-13T01:24:01.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:01.517+0000 7f6ce80c96c0 1 -- 10.20.193.40:0/1516207064 wait complete. 2026-02-13T01:24:01.622 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T01:24:01.622 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:24:01.808 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:02.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.005+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2945881874 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8061050 msgr2=0x7f2eb8154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.005+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2945881874 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8061050 0x7f2eb8154fb0 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=8123585836920430952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea8009970 tx=0x7f2ea802ed10 comp rx=0 tx=0).stop 2026-02-13T01:24:02.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.005+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2945881874 shutdown_connections 2026-02-13T01:24:02.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.005+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2945881874 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2eb81554f0 0x7f2eb81758d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.005+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2945881874 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8061050 0x7f2eb8154fb0 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=8123585836920430952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.005+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2945881874 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2eb8060740 0x7f2eb8060b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.005+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2945881874 >> 10.20.193.40:0/2945881874 conn(0x7f2eb80ea6a0 msgr2=0x7f2eb810aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:02.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.006+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2945881874 shutdown_connections 2026-02-13T01:24:02.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.006+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2945881874 wait complete. 2026-02-13T01:24:02.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.006+0000 7f2ebc9c86c0 1 Processor -- start 2026-02-13T01:24:02.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.006+0000 7f2ebc9c86c0 1 -- start start 2026-02-13T01:24:02.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2ebc9c86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8060740 0x7f2eb81610a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2ebc9c86c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2eb8061050 0x7f2eb81615e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2ebc9c86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2eb81554f0 0x7f2eb81669a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2ebc9c86c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8166ff0 con 0x7f2eb8060740 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2ebc9c86c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8167160 con 0x7f2eb81554f0 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2ebc9c86c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8167320 con 0x7f2eb8061050 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb77fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8060740 0x7f2eb81610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb77fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8060740 0x7f2eb81610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33402/0 (socket says 10.20.193.40:33402) 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb77fe6c0 1 -- 10.20.193.40:0/2091227665 learned_addr learned my addr 10.20.193.40:0/2091227665 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb6ffd6c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2eb8061050 0x7f2eb81615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb7fff6c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2eb81554f0 0x7f2eb81669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb77fe6c0 1 -- 10.20.193.40:0/2091227665 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2eb8061050 msgr2=0x7f2eb81615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb77fe6c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2eb8061050 0x7f2eb81615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb77fe6c0 1 -- 10.20.193.40:0/2091227665 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2eb81554f0 msgr2=0x7f2eb81669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb77fe6c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2eb81554f0 0x7f2eb81669a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb77fe6c0 1 -- 10.20.193.40:0/2091227665 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea8009590 con 0x7f2eb8060740 2026-02-13T01:24:02.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.007+0000 7f2eb77fe6c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8060740 0x7f2eb81610a0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea400b710 tx=0x7f2ea400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:02.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.008+0000 7f2eb4ff96c0 1 -- 10.20.193.40:0/2091227665 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea4004250 con 0x7f2eb8060740 2026-02-13T01:24:02.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.008+0000 7f2eb4ff96c0 1 -- 10.20.193.40:0/2091227665 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2ea4009070 con 0x7f2eb8060740 2026-02-13T01:24:02.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.008+0000 7f2eb4ff96c0 1 -- 10.20.193.40:0/2091227665 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea40071c0 con 0x7f2eb8060740 2026-02-13T01:24:02.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.008+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb8167600 con 0x7f2eb8060740 2026-02-13T01:24:02.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.008+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb8151120 con 0x7f2eb8060740 2026-02-13T01:24:02.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.008+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb8167820 con 0x7f2eb8060740 2026-02-13T01:24:02.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.010+0000 7f2eb4ff96c0 1 -- 10.20.193.40:0/2091227665 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f2ea40043b0 con 0x7f2eb8060740 2026-02-13T01:24:02.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.012+0000 7f2eb4ff96c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2e8c0b5760 0x7f2e8c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.012+0000 7f2eb4ff96c0 1 -- 10.20.193.40:0/2091227665 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f2ea40e3b80 con 0x7f2eb8060740 2026-02-13T01:24:02.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.012+0000 7f2eb6ffd6c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2e8c0b5760 0x7f2e8c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.013+0000 7f2eb4ff96c0 1 -- 10.20.193.40:0/2091227665 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2ea40a64d0 con 0x7f2eb8060740 2026-02-13T01:24:02.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.013+0000 7f2eb6ffd6c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2e8c0b5760 0x7f2e8c0d5c10 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2eb8167a30 tx=0x7f2ea80023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:02.115 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.114+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2eb81621f0 con 0x7f2e8c0b5760 2026-02-13T01:24:02.119 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.118+0000 7f2eb4ff96c0 1 -- 10.20.193.40:0/2091227665 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258769 (secure 0 0 0) 0x7f2eb81621f0 con 0x7f2e8c0b5760 2026-02-13T01:24:02.122 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:02.124 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-13T01:24:02.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.120+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2e8c0b5760 msgr2=0x7f2e8c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.120+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2e8c0b5760 0x7f2e8c0d5c10 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2eb8167a30 tx=0x7f2ea80023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.120+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8060740 msgr2=0x7f2eb81610a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.120+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8060740 0x7f2eb81610a0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea400b710 tx=0x7f2ea400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.121+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 shutdown_connections 2026-02-13T01:24:02.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.121+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f2e8c0b5760 0x7f2e8c0d5c10 unknown :-1 s=CLOSED pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.121+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f2eb81554f0 0x7f2eb81669a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.121+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f2eb8061050 0x7f2eb81615e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.121+0000 7f2ebc9c86c0 1 --2- 10.20.193.40:0/2091227665 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2eb8060740 0x7f2eb81610a0 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.121+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 >> 10.20.193.40:0/2091227665 conn(0x7f2eb80ea6a0 msgr2=0x7f2eb810aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:02.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.121+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 shutdown_connections 2026-02-13T01:24:02.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.121+0000 7f2ebc9c86c0 1 -- 10.20.193.40:0/2091227665 wait complete. 2026-02-13T01:24:02.224 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2026-02-13T01:24:00.689972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602839,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":146,"num_read_kb":124,"num_write":322,"num_write_kb":3766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":334972,"kb_used_data":11404,"kb_used_omap":382,"kb_used_meta":322945,"kb_avail":8807703428,"statfs":{"total":9019431321600,"available":9019088310272,"internally_reserved":0,"allocated":11677696,"data_stored":6483058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":391856,"internal_metadata":330696016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12471,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.618583"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082432+0000","last_change":"2026-02-13T01:23:51.087785+0000","last_active":"2026-02-13T01:23:52.082432+0000","last_peered":"2026-02-13T01:23:52.082432+0000","last_clean":"2026-02-13T01:23:52.082432+0000","last_became_active":"2026-02-13T01:23:51.087666+0000","last_became_peered":"2026-02-13T01:23:51.087666+0000","last_unstale":"2026-02-13T01:23:52.082432+0000","last_undegraded":"2026-02-13T01:23:52.082432+0000","last_fullsized":"2026-02-13T01:23:52.082432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:35.585128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083500+0000","last_change":"2026-02-13T01:23:51.085295+0000","last_active":"2026-02-13T01:23:52.083500+0000","last_peered":"2026-02-13T01:23:52.083500+0000","last_clean":"2026-02-13T01:23:52.083500+0000","last_became_active":"2026-02-13T01:23:51.085131+0000","last_became_peered":"2026-02-13T01:23:51.085131+0000","last_unstale":"2026-02-13T01:23:52.083500+0000","last_undegraded":"2026-02-13T01:23:52.083500+0000","last_fullsized":"2026-02-13T01:23:52.083500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:18.129399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083128+0000","last_change":"2026-02-13T01:23:51.085354+0000","last_active":"2026-02-13T01:23:52.083128+0000","last_peered":"2026-02-13T01:23:52.083128+0000","last_clean":"2026-02-13T01:23:52.083128+0000","last_became_active":"2026-02-13T01:23:51.084953+0000","last_became_peered":"2026-02-13T01:23:51.084953+0000","last_unstale":"2026-02-13T01:23:52.083128+0000","last_undegraded":"2026-02-13T01:23:52.083128+0000","last_fullsized":"2026-02-13T01:23:52.083128+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:32.298388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311720+0000","last_change":"2026-02-13T01:23:51.077255+0000","last_active":"2026-02-13T01:23:52.311720+0000","last_peered":"2026-02-13T01:23:52.311720+0000","last_clean":"2026-02-13T01:23:52.311720+0000","last_became_active":"2026-02-13T01:23:51.076786+0000","last_became_peered":"2026-02-13T01:23:51.076786+0000","last_unstale":"2026-02-13T01:23:52.311720+0000","last_undegraded":"2026-02-13T01:23:52.311720+0000","last_fullsized":"2026-02-13T01:23:52.311720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:25.514019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312471+0000","last_change":"2026-02-13T01:23:51.078791+0000","last_active":"2026-02-13T01:23:52.312471+0000","last_peered":"2026-02-13T01:23:52.312471+0000","last_clean":"2026-02-13T01:23:52.312471+0000","last_became_active":"2026-02-13T01:23:51.078655+0000","last_became_peered":"2026-02-13T01:23:51.078655+0000","last_unstale":"2026-02-13T01:23:52.312471+0000","last_undegraded":"2026-02-13T01:23:52.312471+0000","last_fullsized":"2026-02-13T01:23:52.312471+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:39:11.299004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081309+0000","last_change":"2026-02-13T01:23:51.078732+0000","last_active":"2026-02-13T01:23:52.081309+0000","last_peered":"2026-02-13T01:23:52.081309+0000","last_clean":"2026-02-13T01:23:52.081309+0000","last_became_active":"2026-02-13T01:23:51.078623+0000","last_became_peered":"2026-02-13T01:23:51.078623+0000","last_unstale":"2026-02-13T01:23:52.081309+0000","last_undegraded":"2026-02-13T01:23:52.081309+0000","last_fullsized":"2026-02-13T01:23:52.081309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:44.150512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957653+0000","last_change":"2026-02-13T01:23:51.079852+0000","last_active":"2026-02-13T01:23:52.957653+0000","last_peered":"2026-02-13T01:23:52.957653+0000","last_clean":"2026-02-13T01:23:52.957653+0000","last_became_active":"2026-02-13T01:23:51.079722+0000","last_became_peered":"2026-02-13T01:23:51.079722+0000","last_unstale":"2026-02-13T01:23:52.957653+0000","last_undegraded":"2026-02-13T01:23:52.957653+0000","last_fullsized":"2026-02-13T01:23:52.957653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:05:57.521391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082415+0000","last_change":"2026-02-13T01:23:51.080431+0000","last_active":"2026-02-13T01:23:52.082415+0000","last_peered":"2026-02-13T01:23:52.082415+0000","last_clean":"2026-02-13T01:23:52.082415+0000","last_became_active":"2026-02-13T01:23:51.080137+0000","last_became_peered":"2026-02-13T01:23:51.080137+0000","last_unstale":"2026-02-13T01:23:52.082415+0000","last_undegraded":"2026-02-13T01:23:52.082415+0000","last_fullsized":"2026-02-13T01:23:52.082415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:24.824142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311585+0000","last_change":"2026-02-13T01:23:51.076636+0000","last_active":"2026-02-13T01:23:52.311585+0000","last_peered":"2026-02-13T01:23:52.311585+0000","last_clean":"2026-02-13T01:23:52.311585+0000","last_became_active":"2026-02-13T01:23:51.076457+0000","last_became_peered":"2026-02-13T01:23:51.076457+0000","last_unstale":"2026-02-13T01:23:52.311585+0000","last_undegraded":"2026-02-13T01:23:52.311585+0000","last_fullsized":"2026-02-13T01:23:52.311585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:25:35.580381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081654+0000","last_change":"2026-02-13T01:23:51.077042+0000","last_active":"2026-02-13T01:23:52.081654+0000","last_peered":"2026-02-13T01:23:52.081654+0000","last_clean":"2026-02-13T01:23:52.081654+0000","last_became_active":"2026-02-13T01:23:51.076925+0000","last_became_peered":"2026-02-13T01:23:51.076925+0000","last_unstale":"2026-02-13T01:23:52.081654+0000","last_undegraded":"2026-02-13T01:23:52.081654+0000","last_fullsized":"2026-02-13T01:23:52.081654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:24:36.245078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958059+0000","last_change":"2026-02-13T01:23:51.076945+0000","last_active":"2026-02-13T01:23:52.958059+0000","last_peered":"2026-02-13T01:23:52.958059+0000","last_clean":"2026-02-13T01:23:52.958059+0000","last_became_active":"2026-02-13T01:23:51.076801+0000","last_became_peered":"2026-02-13T01:23:51.076801+0000","last_unstale":"2026-02-13T01:23:52.958059+0000","last_undegraded":"2026-02-13T01:23:52.958059+0000","last_fullsized":"2026-02-13T01:23:52.958059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:14:06.277449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311818+0000","last_change":"2026-02-13T01:23:51.077720+0000","last_active":"2026-02-13T01:23:52.311818+0000","last_peered":"2026-02-13T01:23:52.311818+0000","last_clean":"2026-02-13T01:23:52.311818+0000","last_became_active":"2026-02-13T01:23:51.077217+0000","last_became_peered":"2026-02-13T01:23:51.077217+0000","last_unstale":"2026-02-13T01:23:52.311818+0000","last_undegraded":"2026-02-13T01:23:52.311818+0000","last_fullsized":"2026-02-13T01:23:52.311818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:33.011072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084544+0000","last_change":"2026-02-13T01:23:51.078177+0000","last_active":"2026-02-13T01:23:52.084544+0000","last_peered":"2026-02-13T01:23:52.084544+0000","last_clean":"2026-02-13T01:23:52.084544+0000","last_became_active":"2026-02-13T01:23:51.078110+0000","last_became_peered":"2026-02-13T01:23:51.078110+0000","last_unstale":"2026-02-13T01:23:52.084544+0000","last_undegraded":"2026-02-13T01:23:52.084544+0000","last_fullsized":"2026-02-13T01:23:52.084544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:59.357633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082814+0000","last_change":"2026-02-13T01:23:51.086034+0000","last_active":"2026-02-13T01:23:52.082814+0000","last_peered":"2026-02-13T01:23:52.082814+0000","last_clean":"2026-02-13T01:23:52.082814+0000","last_became_active":"2026-02-13T01:23:51.085782+0000","last_became_peered":"2026-02-13T01:23:51.085782+0000","last_unstale":"2026-02-13T01:23:52.082814+0000","last_undegraded":"2026-02-13T01:23:52.082814+0000","last_fullsized":"2026-02-13T01:23:52.082814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:28:34.185905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082761+0000","last_change":"2026-02-13T01:23:51.082750+0000","last_active":"2026-02-13T01:23:52.082761+0000","last_peered":"2026-02-13T01:23:52.082761+0000","last_clean":"2026-02-13T01:23:52.082761+0000","last_became_active":"2026-02-13T01:23:51.082533+0000","last_became_peered":"2026-02-13T01:23:51.082533+0000","last_unstale":"2026-02-13T01:23:52.082761+0000","last_undegraded":"2026-02-13T01:23:52.082761+0000","last_fullsized":"2026-02-13T01:23:52.082761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:10:33.600010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.310928+0000","last_change":"2026-02-13T01:23:51.083431+0000","last_active":"2026-02-13T01:23:52.310928+0000","last_peered":"2026-02-13T01:23:52.310928+0000","last_clean":"2026-02-13T01:23:52.310928+0000","last_became_active":"2026-02-13T01:23:51.083297+0000","last_became_peered":"2026-02-13T01:23:51.083297+0000","last_unstale":"2026-02-13T01:23:52.310928+0000","last_undegraded":"2026-02-13T01:23:52.310928+0000","last_fullsized":"2026-02-13T01:23:52.310928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:45:36.970802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082486+0000","last_change":"2026-02-13T01:23:51.087754+0000","last_active":"2026-02-13T01:23:52.082486+0000","last_peered":"2026-02-13T01:23:52.082486+0000","last_clean":"2026-02-13T01:23:52.082486+0000","last_became_active":"2026-02-13T01:23:51.087606+0000","last_became_peered":"2026-02-13T01:23:51.087606+0000","last_unstale":"2026-02-13T01:23:52.082486+0000","last_undegraded":"2026-02-13T01:23:52.082486+0000","last_fullsized":"2026-02-13T01:23:52.082486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:15.160137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084350+0000","last_change":"2026-02-13T01:23:51.082589+0000","last_active":"2026-02-13T01:23:52.084350+0000","last_peered":"2026-02-13T01:23:52.084350+0000","last_clean":"2026-02-13T01:23:52.084350+0000","last_became_active":"2026-02-13T01:23:51.081937+0000","last_became_peered":"2026-02-13T01:23:51.081937+0000","last_unstale":"2026-02-13T01:23:52.084350+0000","last_undegraded":"2026-02-13T01:23:52.084350+0000","last_fullsized":"2026-02-13T01:23:52.084350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:23:55.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312722+0000","last_change":"2026-02-13T01:23:51.083199+0000","last_active":"2026-02-13T01:23:52.312722+0000","last_peered":"2026-02-13T01:23:52.312722+0000","last_clean":"2026-02-13T01:23:52.312722+0000","last_became_active":"2026-02-13T01:23:51.083082+0000","last_became_peered":"2026-02-13T01:23:51.083082+0000","last_unstale":"2026-02-13T01:23:52.312722+0000","last_undegraded":"2026-02-13T01:23:52.312722+0000","last_fullsized":"2026-02-13T01:23:52.312722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:40:27.940964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082074+0000","last_change":"2026-02-13T01:23:51.078089+0000","last_active":"2026-02-13T01:23:52.082074+0000","last_peered":"2026-02-13T01:23:52.082074+0000","last_clean":"2026-02-13T01:23:52.082074+0000","last_became_active":"2026-02-13T01:23:51.077949+0000","last_became_peered":"2026-02-13T01:23:51.077949+0000","last_unstale":"2026-02-13T01:23:52.082074+0000","last_undegraded":"2026-02-13T01:23:52.082074+0000","last_fullsized":"2026-02-13T01:23:52.082074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:49:31.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084637+0000","last_change":"2026-02-13T01:23:51.087902+0000","last_active":"2026-02-13T01:23:52.084637+0000","last_peered":"2026-02-13T01:23:52.084637+0000","last_clean":"2026-02-13T01:23:52.084637+0000","last_became_active":"2026-02-13T01:23:51.087588+0000","last_became_peered":"2026-02-13T01:23:51.087588+0000","last_unstale":"2026-02-13T01:23:52.084637+0000","last_undegraded":"2026-02-13T01:23:52.084637+0000","last_fullsized":"2026-02-13T01:23:52.084637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:59:18.831776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311145+0000","last_change":"2026-02-13T01:23:51.082383+0000","last_active":"2026-02-13T01:23:52.311145+0000","last_peered":"2026-02-13T01:23:52.311145+0000","last_clean":"2026-02-13T01:23:52.311145+0000","last_became_active":"2026-02-13T01:23:51.082213+0000","last_became_peered":"2026-02-13T01:23:51.082213+0000","last_unstale":"2026-02-13T01:23:52.311145+0000","last_undegraded":"2026-02-13T01:23:52.311145+0000","last_fullsized":"2026-02-13T01:23:52.311145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:31:53.038095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082509+0000","last_change":"2026-02-13T01:23:51.084995+0000","last_active":"2026-02-13T01:23:52.082509+0000","last_peered":"2026-02-13T01:23:52.082509+0000","last_clean":"2026-02-13T01:23:52.082509+0000","last_became_active":"2026-02-13T01:23:51.084099+0000","last_became_peered":"2026-02-13T01:23:51.084099+0000","last_unstale":"2026-02-13T01:23:52.082509+0000","last_undegraded":"2026-02-13T01:23:52.082509+0000","last_fullsized":"2026-02-13T01:23:52.082509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:28:13.169004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081986+0000","last_change":"2026-02-13T01:23:51.079945+0000","last_active":"2026-02-13T01:23:52.081986+0000","last_peered":"2026-02-13T01:23:52.081986+0000","last_clean":"2026-02-13T01:23:52.081986+0000","last_became_active":"2026-02-13T01:23:51.079769+0000","last_became_peered":"2026-02-13T01:23:51.079769+0000","last_unstale":"2026-02-13T01:23:52.081986+0000","last_undegraded":"2026-02-13T01:23:52.081986+0000","last_fullsized":"2026-02-13T01:23:52.081986+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:35:23.092307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082900+0000","last_change":"2026-02-13T01:23:51.083623+0000","last_active":"2026-02-13T01:23:52.082900+0000","last_peered":"2026-02-13T01:23:52.082900+0000","last_clean":"2026-02-13T01:23:52.082900+0000","last_became_active":"2026-02-13T01:23:51.080812+0000","last_became_peered":"2026-02-13T01:23:51.080812+0000","last_unstale":"2026-02-13T01:23:52.082900+0000","last_undegraded":"2026-02-13T01:23:52.082900+0000","last_fullsized":"2026-02-13T01:23:52.082900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:11.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312793+0000","last_change":"2026-02-13T01:23:51.077158+0000","last_active":"2026-02-13T01:23:52.312793+0000","last_peered":"2026-02-13T01:23:52.312793+0000","last_clean":"2026-02-13T01:23:52.312793+0000","last_became_active":"2026-02-13T01:23:51.077028+0000","last_became_peered":"2026-02-13T01:23:51.077028+0000","last_unstale":"2026-02-13T01:23:52.312793+0000","last_undegraded":"2026-02-13T01:23:52.312793+0000","last_fullsized":"2026-02-13T01:23:52.312793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:58:04.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082315+0000","last_change":"2026-02-13T01:23:51.077585+0000","last_active":"2026-02-13T01:23:52.082315+0000","last_peered":"2026-02-13T01:23:52.082315+0000","last_clean":"2026-02-13T01:23:52.082315+0000","last_became_active":"2026-02-13T01:23:51.077411+0000","last_became_peered":"2026-02-13T01:23:51.077411+0000","last_unstale":"2026-02-13T01:23:52.082315+0000","last_undegraded":"2026-02-13T01:23:52.082315+0000","last_fullsized":"2026-02-13T01:23:52.082315+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:08.469350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084548+0000","last_change":"2026-02-13T01:23:51.087500+0000","last_active":"2026-02-13T01:23:52.084548+0000","last_peered":"2026-02-13T01:23:52.084548+0000","last_clean":"2026-02-13T01:23:52.084548+0000","last_became_active":"2026-02-13T01:23:51.087400+0000","last_became_peered":"2026-02-13T01:23:51.087400+0000","last_unstale":"2026-02-13T01:23:52.084548+0000","last_undegraded":"2026-02-13T01:23:52.084548+0000","last_fullsized":"2026-02-13T01:23:52.084548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:39.858050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083032+0000","last_change":"2026-02-13T01:23:51.086351+0000","last_active":"2026-02-13T01:23:52.083032+0000","last_peered":"2026-02-13T01:23:52.083032+0000","last_clean":"2026-02-13T01:23:52.083032+0000","last_became_active":"2026-02-13T01:23:51.086196+0000","last_became_peered":"2026-02-13T01:23:51.086196+0000","last_unstale":"2026-02-13T01:23:52.083032+0000","last_undegraded":"2026-02-13T01:23:52.083032+0000","last_fullsized":"2026-02-13T01:23:52.083032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:20:51.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312466+0000","last_change":"2026-02-13T01:23:51.086663+0000","last_active":"2026-02-13T01:23:52.312466+0000","last_peered":"2026-02-13T01:23:52.312466+0000","last_clean":"2026-02-13T01:23:52.312466+0000","last_became_active":"2026-02-13T01:23:51.086549+0000","last_became_peered":"2026-02-13T01:23:51.086549+0000","last_unstale":"2026-02-13T01:23:52.312466+0000","last_undegraded":"2026-02-13T01:23:52.312466+0000","last_fullsized":"2026-02-13T01:23:52.312466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:08.297213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312479+0000","last_change":"2026-02-13T01:23:51.079493+0000","last_active":"2026-02-13T01:23:52.312479+0000","last_peered":"2026-02-13T01:23:52.312479+0000","last_clean":"2026-02-13T01:23:52.312479+0000","last_became_active":"2026-02-13T01:23:51.079217+0000","last_became_peered":"2026-02-13T01:23:51.079217+0000","last_unstale":"2026-02-13T01:23:52.312479+0000","last_undegraded":"2026-02-13T01:23:52.312479+0000","last_fullsized":"2026-02-13T01:23:52.312479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:30:24.298223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081960+0000","last_change":"2026-02-13T01:23:51.079378+0000","last_active":"2026-02-13T01:23:52.081960+0000","last_peered":"2026-02-13T01:23:52.081960+0000","last_clean":"2026-02-13T01:23:52.081960+0000","last_became_active":"2026-02-13T01:23:51.079184+0000","last_became_peered":"2026-02-13T01:23:51.079184+0000","last_unstale":"2026-02-13T01:23:52.081960+0000","last_undegraded":"2026-02-13T01:23:52.081960+0000","last_fullsized":"2026-02-13T01:23:52.081960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:28:10.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312491+0000","last_change":"2026-02-13T01:23:51.079975+0000","last_active":"2026-02-13T01:23:52.312491+0000","last_peered":"2026-02-13T01:23:52.312491+0000","last_clean":"2026-02-13T01:23:52.312491+0000","last_became_active":"2026-02-13T01:23:51.079841+0000","last_became_peered":"2026-02-13T01:23:51.079841+0000","last_unstale":"2026-02-13T01:23:52.312491+0000","last_undegraded":"2026-02-13T01:23:52.312491+0000","last_fullsized":"2026-02-13T01:23:52.312491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:28.275600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:58.111330+0000","last_change":"2026-02-13T01:23:50.314202+0000","last_active":"2026-02-13T01:23:58.111330+0000","last_peered":"2026-02-13T01:23:58.111330+0000","last_clean":"2026-02-13T01:23:58.111330+0000","last_became_active":"2026-02-13T01:23:50.313965+0000","last_became_peered":"2026-02-13T01:23:50.313965+0000","last_unstale":"2026-02-13T01:23:58.111330+0000","last_undegraded":"2026-02-13T01:23:58.111330+0000","last_fullsized":"2026-02-13T01:23:58.111330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:58:16.283974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082398+0000","last_change":"2026-02-13T01:23:51.083970+0000","last_active":"2026-02-13T01:23:52.082398+0000","last_peered":"2026-02-13T01:23:52.082398+0000","last_clean":"2026-02-13T01:23:52.082398+0000","last_became_active":"2026-02-13T01:23:51.083823+0000","last_became_peered":"2026-02-13T01:23:51.083823+0000","last_unstale":"2026-02-13T01:23:52.082398+0000","last_undegraded":"2026-02-13T01:23:52.082398+0000","last_fullsized":"2026-02-13T01:23:52.082398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:18:40.333939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103253+0000","last_change":"2026-02-13T01:23:50.315973+0000","last_active":"2026-02-13T01:23:56.103253+0000","last_peered":"2026-02-13T01:23:56.103253+0000","last_clean":"2026-02-13T01:23:56.103253+0000","last_became_active":"2026-02-13T01:23:50.315798+0000","last_became_peered":"2026-02-13T01:23:50.315798+0000","last_unstale":"2026-02-13T01:23:56.103253+0000","last_undegraded":"2026-02-13T01:23:56.103253+0000","last_fullsized":"2026-02-13T01:23:56.103253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:40.079951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.108656+0000","last_change":"2026-02-13T01:23:50.321711+0000","last_active":"2026-02-13T01:23:56.108656+0000","last_peered":"2026-02-13T01:23:56.108656+0000","last_clean":"2026-02-13T01:23:56.108656+0000","last_became_active":"2026-02-13T01:23:50.320547+0000","last_became_peered":"2026-02-13T01:23:50.320547+0000","last_unstale":"2026-02-13T01:23:56.108656+0000","last_undegraded":"2026-02-13T01:23:56.108656+0000","last_fullsized":"2026-02-13T01:23:56.108656+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:07.279129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084082+0000","last_change":"2026-02-13T01:23:51.079484+0000","last_active":"2026-02-13T01:23:52.084082+0000","last_peered":"2026-02-13T01:23:52.084082+0000","last_clean":"2026-02-13T01:23:52.084082+0000","last_became_active":"2026-02-13T01:23:51.079364+0000","last_became_peered":"2026-02-13T01:23:51.079364+0000","last_unstale":"2026-02-13T01:23:52.084082+0000","last_undegraded":"2026-02-13T01:23:52.084082+0000","last_fullsized":"2026-02-13T01:23:52.084082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:46:25.508752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:53.519478+0000","last_change":"2026-02-13T01:23:50.313889+0000","last_active":"2026-02-13T01:23:53.519478+0000","last_peered":"2026-02-13T01:23:53.519478+0000","last_clean":"2026-02-13T01:23:53.519478+0000","last_became_active":"2026-02-13T01:23:50.313686+0000","last_became_peered":"2026-02-13T01:23:50.313686+0000","last_unstale":"2026-02-13T01:23:53.519478+0000","last_undegraded":"2026-02-13T01:23:53.519478+0000","last_fullsized":"2026-02-13T01:23:53.519478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:06.306071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084282+0000","last_change":"2026-02-13T01:23:51.085261+0000","last_active":"2026-02-13T01:23:52.084282+0000","last_peered":"2026-02-13T01:23:52.084282+0000","last_clean":"2026-02-13T01:23:52.084282+0000","last_became_active":"2026-02-13T01:23:51.085174+0000","last_became_peered":"2026-02-13T01:23:51.085174+0000","last_unstale":"2026-02-13T01:23:52.084282+0000","last_undegraded":"2026-02-13T01:23:52.084282+0000","last_fullsized":"2026-02-13T01:23:52.084282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:22:06.653604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100986+0000","last_change":"2026-02-13T01:23:50.319556+0000","last_active":"2026-02-13T01:23:55.100986+0000","last_peered":"2026-02-13T01:23:55.100986+0000","last_clean":"2026-02-13T01:23:55.100986+0000","last_became_active":"2026-02-13T01:23:50.319416+0000","last_became_peered":"2026-02-13T01:23:50.319416+0000","last_unstale":"2026-02-13T01:23:55.100986+0000","last_undegraded":"2026-02-13T01:23:55.100986+0000","last_fullsized":"2026-02-13T01:23:55.100986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:21:13.508452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311504+0000","last_change":"2026-02-13T01:23:51.080630+0000","last_active":"2026-02-13T01:23:52.311504+0000","last_peered":"2026-02-13T01:23:52.311504+0000","last_clean":"2026-02-13T01:23:52.311504+0000","last_became_active":"2026-02-13T01:23:51.080523+0000","last_became_peered":"2026-02-13T01:23:51.080523+0000","last_unstale":"2026-02-13T01:23:52.311504+0000","last_undegraded":"2026-02-13T01:23:52.311504+0000","last_fullsized":"2026-02-13T01:23:52.311504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:31:27.515871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.099151+0000","last_change":"2026-02-13T01:23:50.313353+0000","last_active":"2026-02-13T01:23:55.099151+0000","last_peered":"2026-02-13T01:23:55.099151+0000","last_clean":"2026-02-13T01:23:55.099151+0000","last_became_active":"2026-02-13T01:23:50.312960+0000","last_became_peered":"2026-02-13T01:23:50.312960+0000","last_unstale":"2026-02-13T01:23:55.099151+0000","last_undegraded":"2026-02-13T01:23:55.099151+0000","last_fullsized":"2026-02-13T01:23:55.099151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:17.457348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083218+0000","last_change":"2026-02-13T01:23:51.085556+0000","last_active":"2026-02-13T01:23:52.083218+0000","last_peered":"2026-02-13T01:23:52.083218+0000","last_clean":"2026-02-13T01:23:52.083218+0000","last_became_active":"2026-02-13T01:23:51.084737+0000","last_became_peered":"2026-02-13T01:23:51.084737+0000","last_unstale":"2026-02-13T01:23:52.083218+0000","last_undegraded":"2026-02-13T01:23:52.083218+0000","last_fullsized":"2026-02-13T01:23:52.083218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:34.732291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.102259+0000","last_change":"2026-02-13T01:23:50.314013+0000","last_active":"2026-02-13T01:23:55.102259+0000","last_peered":"2026-02-13T01:23:55.102259+0000","last_clean":"2026-02-13T01:23:55.102259+0000","last_became_active":"2026-02-13T01:23:50.313750+0000","last_became_peered":"2026-02-13T01:23:50.313750+0000","last_unstale":"2026-02-13T01:23:55.102259+0000","last_undegraded":"2026-02-13T01:23:55.102259+0000","last_fullsized":"2026-02-13T01:23:55.102259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:11.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311298+0000","last_change":"2026-02-13T01:23:51.078331+0000","last_active":"2026-02-13T01:23:52.311298+0000","last_peered":"2026-02-13T01:23:52.311298+0000","last_clean":"2026-02-13T01:23:52.311298+0000","last_became_active":"2026-02-13T01:23:51.078107+0000","last_became_peered":"2026-02-13T01:23:51.078107+0000","last_unstale":"2026-02-13T01:23:52.311298+0000","last_undegraded":"2026-02-13T01:23:52.311298+0000","last_fullsized":"2026-02-13T01:23:52.311298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:01.797388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'11","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.718863+0000","last_change":"2026-02-13T01:23:50.312858+0000","last_active":"2026-02-13T01:23:57.718863+0000","last_peered":"2026-02-13T01:23:57.718863+0000","last_clean":"2026-02-13T01:23:57.718863+0000","last_became_active":"2026-02-13T01:23:50.312641+0000","last_became_peered":"2026-02-13T01:23:50.312641+0000","last_unstale":"2026-02-13T01:23:57.718863+0000","last_undegraded":"2026-02-13T01:23:57.718863+0000","last_fullsized":"2026-02-13T01:23:57.718863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:14.572231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312665+0000","last_change":"2026-02-13T01:23:51.077407+0000","last_active":"2026-02-13T01:23:52.312665+0000","last_peered":"2026-02-13T01:23:52.312665+0000","last_clean":"2026-02-13T01:23:52.312665+0000","last_became_active":"2026-02-13T01:23:51.077180+0000","last_became_peered":"2026-02-13T01:23:51.077180+0000","last_unstale":"2026-02-13T01:23:52.312665+0000","last_undegraded":"2026-02-13T01:23:52.312665+0000","last_fullsized":"2026-02-13T01:23:52.312665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:40:00.558376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104764+0000","last_change":"2026-02-13T01:23:50.313114+0000","last_active":"2026-02-13T01:23:56.104764+0000","last_peered":"2026-02-13T01:23:56.104764+0000","last_clean":"2026-02-13T01:23:56.104764+0000","last_became_active":"2026-02-13T01:23:50.312955+0000","last_became_peered":"2026-02-13T01:23:50.312955+0000","last_unstale":"2026-02-13T01:23:56.104764+0000","last_undegraded":"2026-02-13T01:23:56.104764+0000","last_fullsized":"2026-02-13T01:23:56.104764+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:48:28.664538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084295+0000","last_change":"2026-02-13T01:23:51.087820+0000","last_active":"2026-02-13T01:23:52.084295+0000","last_peered":"2026-02-13T01:23:52.084295+0000","last_clean":"2026-02-13T01:23:52.084295+0000","last_became_active":"2026-02-13T01:23:51.087642+0000","last_became_peered":"2026-02-13T01:23:51.087642+0000","last_unstale":"2026-02-13T01:23:52.084295+0000","last_undegraded":"2026-02-13T01:23:52.084295+0000","last_fullsized":"2026-02-13T01:23:52.084295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:53:35.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.101071+0000","last_change":"2026-02-13T01:23:50.317064+0000","last_active":"2026-02-13T01:23:55.101071+0000","last_peered":"2026-02-13T01:23:55.101071+0000","last_clean":"2026-02-13T01:23:55.101071+0000","last_became_active":"2026-02-13T01:23:50.316871+0000","last_became_peered":"2026-02-13T01:23:50.316871+0000","last_unstale":"2026-02-13T01:23:55.101071+0000","last_undegraded":"2026-02-13T01:23:55.101071+0000","last_fullsized":"2026-02-13T01:23:55.101071+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:16.140406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957948+0000","last_change":"2026-02-13T01:23:51.076041+0000","last_active":"2026-02-13T01:23:52.957948+0000","last_peered":"2026-02-13T01:23:52.957948+0000","last_clean":"2026-02-13T01:23:52.957948+0000","last_became_active":"2026-02-13T01:23:51.075750+0000","last_became_peered":"2026-02-13T01:23:51.075750+0000","last_unstale":"2026-02-13T01:23:52.957948+0000","last_undegraded":"2026-02-13T01:23:52.957948+0000","last_fullsized":"2026-02-13T01:23:52.957948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:37:15.723754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:59.111359+0000","last_change":"2026-02-13T01:23:50.312631+0000","last_active":"2026-02-13T01:23:59.111359+0000","last_peered":"2026-02-13T01:23:59.111359+0000","last_clean":"2026-02-13T01:23:59.111359+0000","last_became_active":"2026-02-13T01:23:50.312445+0000","last_became_peered":"2026-02-13T01:23:50.312445+0000","last_unstale":"2026-02-13T01:23:59.111359+0000","last_undegraded":"2026-02-13T01:23:59.111359+0000","last_fullsized":"2026-02-13T01:23:59.111359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:40.527470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957625+0000","last_change":"2026-02-13T01:23:51.078230+0000","last_active":"2026-02-13T01:23:52.957625+0000","last_peered":"2026-02-13T01:23:52.957625+0000","last_clean":"2026-02-13T01:23:52.957625+0000","last_became_active":"2026-02-13T01:23:51.078113+0000","last_became_peered":"2026-02-13T01:23:51.078113+0000","last_unstale":"2026-02-13T01:23:52.957625+0000","last_undegraded":"2026-02-13T01:23:52.957625+0000","last_fullsized":"2026-02-13T01:23:52.957625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:09.649368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104938+0000","last_change":"2026-02-13T01:23:50.314144+0000","last_active":"2026-02-13T01:23:56.104938+0000","last_peered":"2026-02-13T01:23:56.104938+0000","last_clean":"2026-02-13T01:23:56.104938+0000","last_became_active":"2026-02-13T01:23:50.313897+0000","last_became_peered":"2026-02-13T01:23:50.313897+0000","last_unstale":"2026-02-13T01:23:56.104938+0000","last_undegraded":"2026-02-13T01:23:56.104938+0000","last_fullsized":"2026-02-13T01:23:56.104938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:36:50.923122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082071+0000","last_change":"2026-02-13T01:23:51.078401+0000","last_active":"2026-02-13T01:23:52.082071+0000","last_peered":"2026-02-13T01:23:52.082071+0000","last_clean":"2026-02-13T01:23:52.082071+0000","last_became_active":"2026-02-13T01:23:51.078113+0000","last_became_peered":"2026-02-13T01:23:51.078113+0000","last_unstale":"2026-02-13T01:23:52.082071+0000","last_undegraded":"2026-02-13T01:23:52.082071+0000","last_fullsized":"2026-02-13T01:23:52.082071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:38:58.059781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.108405+0000","last_change":"2026-02-13T01:23:50.311883+0000","last_active":"2026-02-13T01:23:57.108405+0000","last_peered":"2026-02-13T01:23:57.108405+0000","last_clean":"2026-02-13T01:23:57.108405+0000","last_became_active":"2026-02-13T01:23:50.311677+0000","last_became_peered":"2026-02-13T01:23:50.311677+0000","last_unstale":"2026-02-13T01:23:57.108405+0000","last_undegraded":"2026-02-13T01:23:57.108405+0000","last_fullsized":"2026-02-13T01:23:57.108405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:03:41.688088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082293+0000","last_change":"2026-02-13T01:23:51.077302+0000","last_active":"2026-02-13T01:23:52.082293+0000","last_peered":"2026-02-13T01:23:52.082293+0000","last_clean":"2026-02-13T01:23:52.082293+0000","last_became_active":"2026-02-13T01:23:51.077062+0000","last_became_peered":"2026-02-13T01:23:51.077062+0000","last_unstale":"2026-02-13T01:23:52.082293+0000","last_undegraded":"2026-02-13T01:23:52.082293+0000","last_fullsized":"2026-02-13T01:23:52.082293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:29:19.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084451+0000","last_change":"2026-02-13T01:23:50.318138+0000","last_active":"2026-02-13T01:23:52.084451+0000","last_peered":"2026-02-13T01:23:52.084451+0000","last_clean":"2026-02-13T01:23:52.084451+0000","last_became_active":"2026-02-13T01:23:50.318046+0000","last_became_peered":"2026-02-13T01:23:50.318046+0000","last_unstale":"2026-02-13T01:23:52.084451+0000","last_undegraded":"2026-02-13T01:23:52.084451+0000","last_fullsized":"2026-02-13T01:23:52.084451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:08:08.981534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958104+0000","last_change":"2026-02-13T01:23:51.076583+0000","last_active":"2026-02-13T01:23:52.958104+0000","last_peered":"2026-02-13T01:23:52.958104+0000","last_clean":"2026-02-13T01:23:52.958104+0000","last_became_active":"2026-02-13T01:23:51.076410+0000","last_became_peered":"2026-02-13T01:23:51.076410+0000","last_unstale":"2026-02-13T01:23:52.958104+0000","last_undegraded":"2026-02-13T01:23:52.958104+0000","last_fullsized":"2026-02-13T01:23:52.958104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:32.267216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:53.519536+0000","last_change":"2026-02-13T01:23:50.314790+0000","last_active":"2026-02-13T01:23:53.519536+0000","last_peered":"2026-02-13T01:23:53.519536+0000","last_clean":"2026-02-13T01:23:53.519536+0000","last_became_active":"2026-02-13T01:23:50.314648+0000","last_became_peered":"2026-02-13T01:23:50.314648+0000","last_unstale":"2026-02-13T01:23:53.519536+0000","last_undegraded":"2026-02-13T01:23:53.519536+0000","last_fullsized":"2026-02-13T01:23:53.519536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:07:25.610347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957957+0000","last_change":"2026-02-13T01:23:51.078869+0000","last_active":"2026-02-13T01:23:52.957957+0000","last_peered":"2026-02-13T01:23:52.957957+0000","last_clean":"2026-02-13T01:23:52.957957+0000","last_became_active":"2026-02-13T01:23:51.078734+0000","last_became_peered":"2026-02-13T01:23:51.078734+0000","last_unstale":"2026-02-13T01:23:52.957957+0000","last_undegraded":"2026-02-13T01:23:52.957957+0000","last_fullsized":"2026-02-13T01:23:52.957957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:14:50.870485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104919+0000","last_change":"2026-02-13T01:23:50.316821+0000","last_active":"2026-02-13T01:23:56.104919+0000","last_peered":"2026-02-13T01:23:56.104919+0000","last_clean":"2026-02-13T01:23:56.104919+0000","last_became_active":"2026-02-13T01:23:50.316669+0000","last_became_peered":"2026-02-13T01:23:50.316669+0000","last_unstale":"2026-02-13T01:23:56.104919+0000","last_undegraded":"2026-02-13T01:23:56.104919+0000","last_fullsized":"2026-02-13T01:23:56.104919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:52:17.159425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958080+0000","last_change":"2026-02-13T01:23:51.076521+0000","last_active":"2026-02-13T01:23:52.958080+0000","last_peered":"2026-02-13T01:23:52.958080+0000","last_clean":"2026-02-13T01:23:52.958080+0000","last_became_active":"2026-02-13T01:23:51.076219+0000","last_became_peered":"2026-02-13T01:23:51.076219+0000","last_unstale":"2026-02-13T01:23:52.958080+0000","last_undegraded":"2026-02-13T01:23:52.958080+0000","last_fullsized":"2026-02-13T01:23:52.958080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:10:05.735481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":345,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957697+0000","last_change":"2026-02-13T01:23:25.213241+0000","last_active":"2026-02-13T01:23:52.957697+0000","last_peered":"2026-02-13T01:23:52.957697+0000","last_clean":"2026-02-13T01:23:52.957697+0000","last_became_active":"2026-02-13T01:23:25.213096+0000","last_became_peered":"2026-02-13T01:23:25.213096+0000","last_unstale":"2026-02-13T01:23:52.957697+0000","last_undegraded":"2026-02-13T01:23:52.957697+0000","last_fullsized":"2026-02-13T01:23:52.957697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:22:12.252296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:22:12.252296+0000","last_clean_scrub_stamp":"2026-02-13T01:22:12.252296+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:12:54.951823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.108146+0000","last_change":"2026-02-13T01:23:50.318186+0000","last_active":"2026-02-13T01:23:57.108146+0000","last_peered":"2026-02-13T01:23:57.108146+0000","last_clean":"2026-02-13T01:23:57.108146+0000","last_became_active":"2026-02-13T01:23:50.318061+0000","last_became_peered":"2026-02-13T01:23:50.318061+0000","last_unstale":"2026-02-13T01:23:57.108146+0000","last_undegraded":"2026-02-13T01:23:57.108146+0000","last_fullsized":"2026-02-13T01:23:57.108146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:10:10.620620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082418+0000","last_change":"2026-02-13T01:23:51.085525+0000","last_active":"2026-02-13T01:23:52.082418+0000","last_peered":"2026-02-13T01:23:52.082418+0000","last_clean":"2026-02-13T01:23:52.082418+0000","last_became_active":"2026-02-13T01:23:51.084975+0000","last_became_peered":"2026-02-13T01:23:51.084975+0000","last_unstale":"2026-02-13T01:23:52.082418+0000","last_undegraded":"2026-02-13T01:23:52.082418+0000","last_fullsized":"2026-02-13T01:23:52.082418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:01:08.986008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103570+0000","last_change":"2026-02-13T01:23:50.313460+0000","last_active":"2026-02-13T01:23:56.103570+0000","last_peered":"2026-02-13T01:23:56.103570+0000","last_clean":"2026-02-13T01:23:56.103570+0000","last_became_active":"2026-02-13T01:23:50.313104+0000","last_became_peered":"2026-02-13T01:23:50.313104+0000","last_unstale":"2026-02-13T01:23:56.103570+0000","last_undegraded":"2026-02-13T01:23:56.103570+0000","last_fullsized":"2026-02-13T01:23:56.103570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:52:48.495789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082426+0000","last_change":"2026-02-13T01:23:51.078650+0000","last_active":"2026-02-13T01:23:52.082426+0000","last_peered":"2026-02-13T01:23:52.082426+0000","last_clean":"2026-02-13T01:23:52.082426+0000","last_became_active":"2026-02-13T01:23:51.078574+0000","last_became_peered":"2026-02-13T01:23:51.078574+0000","last_unstale":"2026-02-13T01:23:52.082426+0000","last_undegraded":"2026-02-13T01:23:52.082426+0000","last_fullsized":"2026-02-13T01:23:52.082426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:06.316722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.110453+0000","last_change":"2026-02-13T01:23:50.319269+0000","last_active":"2026-02-13T01:23:57.110453+0000","last_peered":"2026-02-13T01:23:57.110453+0000","last_clean":"2026-02-13T01:23:57.110453+0000","last_became_active":"2026-02-13T01:23:50.319131+0000","last_became_peered":"2026-02-13T01:23:50.319131+0000","last_unstale":"2026-02-13T01:23:57.110453+0000","last_undegraded":"2026-02-13T01:23:57.110453+0000","last_fullsized":"2026-02-13T01:23:57.110453+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:44:36.267282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081966+0000","last_change":"2026-02-13T01:23:51.079014+0000","last_active":"2026-02-13T01:23:52.081966+0000","last_peered":"2026-02-13T01:23:52.081966+0000","last_clean":"2026-02-13T01:23:52.081966+0000","last_became_active":"2026-02-13T01:23:51.078573+0000","last_became_peered":"2026-02-13T01:23:51.078573+0000","last_unstale":"2026-02-13T01:23:52.081966+0000","last_undegraded":"2026-02-13T01:23:52.081966+0000","last_fullsized":"2026-02-13T01:23:52.081966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:32:44.455948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957935+0000","last_change":"2026-02-13T01:23:50.317728+0000","last_active":"2026-02-13T01:23:52.957935+0000","last_peered":"2026-02-13T01:23:52.957935+0000","last_clean":"2026-02-13T01:23:52.957935+0000","last_became_active":"2026-02-13T01:23:50.317565+0000","last_became_peered":"2026-02-13T01:23:50.317565+0000","last_unstale":"2026-02-13T01:23:52.957935+0000","last_undegraded":"2026-02-13T01:23:52.957935+0000","last_fullsized":"2026-02-13T01:23:52.957935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:12:48.426265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081343+0000","last_change":"2026-02-13T01:23:51.085691+0000","last_active":"2026-02-13T01:23:52.081343+0000","last_peered":"2026-02-13T01:23:52.081343+0000","last_clean":"2026-02-13T01:23:52.081343+0000","last_became_active":"2026-02-13T01:23:51.085545+0000","last_became_peered":"2026-02-13T01:23:51.085545+0000","last_unstale":"2026-02-13T01:23:52.081343+0000","last_undegraded":"2026-02-13T01:23:52.081343+0000","last_fullsized":"2026-02-13T01:23:52.081343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:23.233907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084229+0000","last_change":"2026-02-13T01:23:50.320080+0000","last_active":"2026-02-13T01:23:52.084229+0000","last_peered":"2026-02-13T01:23:52.084229+0000","last_clean":"2026-02-13T01:23:52.084229+0000","last_became_active":"2026-02-13T01:23:50.319075+0000","last_became_peered":"2026-02-13T01:23:50.319075+0000","last_unstale":"2026-02-13T01:23:52.084229+0000","last_undegraded":"2026-02-13T01:23:52.084229+0000","last_fullsized":"2026-02-13T01:23:52.084229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:58:22.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081431+0000","last_change":"2026-02-13T01:23:51.082738+0000","last_active":"2026-02-13T01:23:52.081431+0000","last_peered":"2026-02-13T01:23:52.081431+0000","last_clean":"2026-02-13T01:23:52.081431+0000","last_became_active":"2026-02-13T01:23:51.082642+0000","last_became_peered":"2026-02-13T01:23:51.082642+0000","last_unstale":"2026-02-13T01:23:52.081431+0000","last_undegraded":"2026-02-13T01:23:52.081431+0000","last_fullsized":"2026-02-13T01:23:52.081431+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:21.938336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.101867+0000","last_change":"2026-02-13T01:23:50.319590+0000","last_active":"2026-02-13T01:23:55.101867+0000","last_peered":"2026-02-13T01:23:55.101867+0000","last_clean":"2026-02-13T01:23:55.101867+0000","last_became_active":"2026-02-13T01:23:50.319400+0000","last_became_peered":"2026-02-13T01:23:50.319400+0000","last_unstale":"2026-02-13T01:23:55.101867+0000","last_undegraded":"2026-02-13T01:23:55.101867+0000","last_fullsized":"2026-02-13T01:23:55.101867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:09:14.320587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084625+0000","last_change":"2026-02-13T01:23:51.086949+0000","last_active":"2026-02-13T01:23:52.084625+0000","last_peered":"2026-02-13T01:23:52.084625+0000","last_clean":"2026-02-13T01:23:52.084625+0000","last_became_active":"2026-02-13T01:23:51.083288+0000","last_became_peered":"2026-02-13T01:23:51.083288+0000","last_unstale":"2026-02-13T01:23:52.084625+0000","last_undegraded":"2026-02-13T01:23:52.084625+0000","last_fullsized":"2026-02-13T01:23:52.084625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:49:21.017914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'5","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:58.312410+0000","last_change":"2026-02-13T01:23:50.321788+0000","last_active":"2026-02-13T01:23:58.312410+0000","last_peered":"2026-02-13T01:23:58.312410+0000","last_clean":"2026-02-13T01:23:58.312410+0000","last_became_active":"2026-02-13T01:23:50.321507+0000","last_became_peered":"2026-02-13T01:23:50.321507+0000","last_unstale":"2026-02-13T01:23:58.312410+0000","last_undegraded":"2026-02-13T01:23:58.312410+0000","last_fullsized":"2026-02-13T01:23:58.312410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:05:53.096866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082956+0000","last_change":"2026-02-13T01:23:51.080914+0000","last_active":"2026-02-13T01:23:52.082956+0000","last_peered":"2026-02-13T01:23:52.082956+0000","last_clean":"2026-02-13T01:23:52.082956+0000","last_became_active":"2026-02-13T01:23:51.080613+0000","last_became_peered":"2026-02-13T01:23:51.080613+0000","last_unstale":"2026-02-13T01:23:52.082956+0000","last_undegraded":"2026-02-13T01:23:52.082956+0000","last_fullsized":"2026-02-13T01:23:52.082956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:27:22.311625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.098873+0000","last_change":"2026-02-13T01:23:50.317704+0000","last_active":"2026-02-13T01:23:55.098873+0000","last_peered":"2026-02-13T01:23:55.098873+0000","last_clean":"2026-02-13T01:23:55.098873+0000","last_became_active":"2026-02-13T01:23:50.317518+0000","last_became_peered":"2026-02-13T01:23:50.317518+0000","last_unstale":"2026-02-13T01:23:55.098873+0000","last_undegraded":"2026-02-13T01:23:55.098873+0000","last_fullsized":"2026-02-13T01:23:55.098873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:32:42.982192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083552+0000","last_change":"2026-02-13T01:23:51.082748+0000","last_active":"2026-02-13T01:23:52.083552+0000","last_peered":"2026-02-13T01:23:52.083552+0000","last_clean":"2026-02-13T01:23:52.083552+0000","last_became_active":"2026-02-13T01:23:51.082558+0000","last_became_peered":"2026-02-13T01:23:51.082558+0000","last_unstale":"2026-02-13T01:23:52.083552+0000","last_undegraded":"2026-02-13T01:23:52.083552+0000","last_fullsized":"2026-02-13T01:23:52.083552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:59:02.330871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100274+0000","last_change":"2026-02-13T01:23:50.316483+0000","last_active":"2026-02-13T01:23:55.100274+0000","last_peered":"2026-02-13T01:23:55.100274+0000","last_clean":"2026-02-13T01:23:55.100274+0000","last_became_active":"2026-02-13T01:23:50.316364+0000","last_became_peered":"2026-02-13T01:23:50.316364+0000","last_unstale":"2026-02-13T01:23:55.100274+0000","last_undegraded":"2026-02-13T01:23:55.100274+0000","last_fullsized":"2026-02-13T01:23:55.100274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:59:40.790096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312297+0000","last_change":"2026-02-13T01:23:51.077851+0000","last_active":"2026-02-13T01:23:52.312297+0000","last_peered":"2026-02-13T01:23:52.312297+0000","last_clean":"2026-02-13T01:23:52.312297+0000","last_became_active":"2026-02-13T01:23:51.077601+0000","last_became_peered":"2026-02-13T01:23:51.077601+0000","last_unstale":"2026-02-13T01:23:52.312297+0000","last_undegraded":"2026-02-13T01:23:52.312297+0000","last_fullsized":"2026-02-13T01:23:52.312297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:12.303405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.102650+0000","last_change":"2026-02-13T01:23:50.320431+0000","last_active":"2026-02-13T01:23:55.102650+0000","last_peered":"2026-02-13T01:23:55.102650+0000","last_clean":"2026-02-13T01:23:55.102650+0000","last_became_active":"2026-02-13T01:23:50.320143+0000","last_became_peered":"2026-02-13T01:23:50.320143+0000","last_unstale":"2026-02-13T01:23:55.102650+0000","last_undegraded":"2026-02-13T01:23:55.102650+0000","last_fullsized":"2026-02-13T01:23:55.102650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:33:25.290532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082293+0000","last_change":"2026-02-13T01:23:51.084550+0000","last_active":"2026-02-13T01:23:52.082293+0000","last_peered":"2026-02-13T01:23:52.082293+0000","last_clean":"2026-02-13T01:23:52.082293+0000","last_became_active":"2026-02-13T01:23:51.084383+0000","last_became_peered":"2026-02-13T01:23:51.084383+0000","last_unstale":"2026-02-13T01:23:52.082293+0000","last_undegraded":"2026-02-13T01:23:52.082293+0000","last_fullsized":"2026-02-13T01:23:52.082293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:04:28.333381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.974521+0000","last_change":"2026-02-13T01:23:50.317598+0000","last_active":"2026-02-13T01:23:52.974521+0000","last_peered":"2026-02-13T01:23:52.974521+0000","last_clean":"2026-02-13T01:23:52.974521+0000","last_became_active":"2026-02-13T01:23:50.317423+0000","last_became_peered":"2026-02-13T01:23:50.317423+0000","last_unstale":"2026-02-13T01:23:52.974521+0000","last_undegraded":"2026-02-13T01:23:52.974521+0000","last_fullsized":"2026-02-13T01:23:52.974521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:59:04.861370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082998+0000","last_change":"2026-02-13T01:23:51.086322+0000","last_active":"2026-02-13T01:23:52.082998+0000","last_peered":"2026-02-13T01:23:52.082998+0000","last_clean":"2026-02-13T01:23:52.082998+0000","last_became_active":"2026-02-13T01:23:51.086198+0000","last_became_peered":"2026-02-13T01:23:51.086198+0000","last_unstale":"2026-02-13T01:23:52.082998+0000","last_undegraded":"2026-02-13T01:23:52.082998+0000","last_fullsized":"2026-02-13T01:23:52.082998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:59.547632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100675+0000","last_change":"2026-02-13T01:23:50.313658+0000","last_active":"2026-02-13T01:23:55.100675+0000","last_peered":"2026-02-13T01:23:55.100675+0000","last_clean":"2026-02-13T01:23:55.100675+0000","last_became_active":"2026-02-13T01:23:50.313515+0000","last_became_peered":"2026-02-13T01:23:50.313515+0000","last_unstale":"2026-02-13T01:23:55.100675+0000","last_undegraded":"2026-02-13T01:23:55.100675+0000","last_fullsized":"2026-02-13T01:23:55.100675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:17.507776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957957+0000","last_change":"2026-02-13T01:23:51.075832+0000","last_active":"2026-02-13T01:23:52.957957+0000","last_peered":"2026-02-13T01:23:52.957957+0000","last_clean":"2026-02-13T01:23:52.957957+0000","last_became_active":"2026-02-13T01:23:51.075617+0000","last_became_peered":"2026-02-13T01:23:51.075617+0000","last_unstale":"2026-02-13T01:23:52.957957+0000","last_undegraded":"2026-02-13T01:23:52.957957+0000","last_fullsized":"2026-02-13T01:23:52.957957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:49.567688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082616+0000","last_change":"2026-02-13T01:23:51.078417+0000","last_active":"2026-02-13T01:23:52.082616+0000","last_peered":"2026-02-13T01:23:52.082616+0000","last_clean":"2026-02-13T01:23:52.082616+0000","last_became_active":"2026-02-13T01:23:51.078110+0000","last_became_peered":"2026-02-13T01:23:51.078110+0000","last_unstale":"2026-02-13T01:23:52.082616+0000","last_undegraded":"2026-02-13T01:23:52.082616+0000","last_fullsized":"2026-02-13T01:23:52.082616+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:40:32.031019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312559+0000","last_change":"2026-02-13T01:23:50.313168+0000","last_active":"2026-02-13T01:23:52.312559+0000","last_peered":"2026-02-13T01:23:52.312559+0000","last_clean":"2026-02-13T01:23:52.312559+0000","last_became_active":"2026-02-13T01:23:50.312966+0000","last_became_peered":"2026-02-13T01:23:50.312966+0000","last_unstale":"2026-02-13T01:23:52.312559+0000","last_undegraded":"2026-02-13T01:23:52.312559+0000","last_fullsized":"2026-02-13T01:23:52.312559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:32.590208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311295+0000","last_change":"2026-02-13T01:23:51.076660+0000","last_active":"2026-02-13T01:23:52.311295+0000","last_peered":"2026-02-13T01:23:52.311295+0000","last_clean":"2026-02-13T01:23:52.311295+0000","last_became_active":"2026-02-13T01:23:51.076469+0000","last_became_peered":"2026-02-13T01:23:51.076469+0000","last_unstale":"2026-02-13T01:23:52.311295+0000","last_undegraded":"2026-02-13T01:23:52.311295+0000","last_fullsized":"2026-02-13T01:23:52.311295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:36:41.529123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103548+0000","last_change":"2026-02-13T01:23:50.314141+0000","last_active":"2026-02-13T01:23:56.103548+0000","last_peered":"2026-02-13T01:23:56.103548+0000","last_clean":"2026-02-13T01:23:56.103548+0000","last_became_active":"2026-02-13T01:23:50.313895+0000","last_became_peered":"2026-02-13T01:23:50.313895+0000","last_unstale":"2026-02-13T01:23:56.103548+0000","last_undegraded":"2026-02-13T01:23:56.103548+0000","last_fullsized":"2026-02-13T01:23:56.103548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:56:45.835321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083174+0000","last_change":"2026-02-13T01:23:51.087445+0000","last_active":"2026-02-13T01:23:52.083174+0000","last_peered":"2026-02-13T01:23:52.083174+0000","last_clean":"2026-02-13T01:23:52.083174+0000","last_became_active":"2026-02-13T01:23:51.087127+0000","last_became_peered":"2026-02-13T01:23:51.087127+0000","last_unstale":"2026-02-13T01:23:52.083174+0000","last_undegraded":"2026-02-13T01:23:52.083174+0000","last_fullsized":"2026-02-13T01:23:52.083174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:26:20.819554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.289274+0000","last_change":"2026-02-13T01:23:50.317601+0000","last_active":"2026-02-13T01:23:52.289274+0000","last_peered":"2026-02-13T01:23:52.289274+0000","last_clean":"2026-02-13T01:23:52.289274+0000","last_became_active":"2026-02-13T01:23:50.316929+0000","last_became_peered":"2026-02-13T01:23:50.316929+0000","last_unstale":"2026-02-13T01:23:52.289274+0000","last_undegraded":"2026-02-13T01:23:52.289274+0000","last_fullsized":"2026-02-13T01:23:52.289274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:53:18.429548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083050+0000","last_change":"2026-02-13T01:23:51.080679+0000","last_active":"2026-02-13T01:23:52.083050+0000","last_peered":"2026-02-13T01:23:52.083050+0000","last_clean":"2026-02-13T01:23:52.083050+0000","last_became_active":"2026-02-13T01:23:51.080556+0000","last_became_peered":"2026-02-13T01:23:51.080556+0000","last_unstale":"2026-02-13T01:23:52.083050+0000","last_undegraded":"2026-02-13T01:23:52.083050+0000","last_fullsized":"2026-02-13T01:23:52.083050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:21.252518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.107473+0000","last_change":"2026-02-13T01:23:50.319592+0000","last_active":"2026-02-13T01:23:56.107473+0000","last_peered":"2026-02-13T01:23:56.107473+0000","last_clean":"2026-02-13T01:23:56.107473+0000","last_became_active":"2026-02-13T01:23:50.319512+0000","last_became_peered":"2026-02-13T01:23:50.319512+0000","last_unstale":"2026-02-13T01:23:56.107473+0000","last_undegraded":"2026-02-13T01:23:56.107473+0000","last_fullsized":"2026-02-13T01:23:56.107473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:49.061751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12471,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":77021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":141327,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743430,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27748,"kb_used_data":784,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975452,"statfs":{"total":751619276800,"available":751590862848,"internally_reserved":0,"allocated":802816,"data_stored":389438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8794,"internal_metadata":27581862},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972360,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28372,"kb_used_data":1408,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733974828,"statfs":{"total":751619276800,"available":751590223872,"internally_reserved":0,"allocated":1441792,"data_stored":983040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24624,"internal_metadata":27566032},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103178,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":390278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23449,"internal_metadata":27567207},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332108,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":390198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31062,"internal_metadata":27559594},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561037,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28340,"kb_used_data":1376,"kb_used_omap":17,"kb_used_meta":26926,"kb_avail":733974860,"statfs":{"total":751619276800,"available":751590256640,"internally_reserved":0,"allocated":1409024,"data_stored":981032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18358,"internal_metadata":27572298},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":389528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134,"internal_metadata":27565522},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920786,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28356,"kb_used_data":1392,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733974844,"statfs":{"total":751619276800,"available":751590240256,"internally_reserved":0,"allocated":1425408,"data_stored":981304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31302,"internal_metadata":27559354},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051603,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":390082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37333,"internal_metadata":27553323},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280532,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":389722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44563,"internal_metadata":27546093},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":54,"kb_used_meta":26889,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":392444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55586,"internal_metadata":27535070},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607576,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":415032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":390960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47331,"internal_metadata":27543325},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7583,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":10167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29616,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32092,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7908,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3458,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4500,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11384,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12333,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8608,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":9985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18036,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4096,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:24:02.231 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:24:02.404 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:02 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1516207064' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:02.417 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:02.459 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:02 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1516207064' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:02.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:02 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1516207064' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:02.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.605+0000 7fa07c3286c0 1 -- 10.20.193.40:0/4288796590 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410fbf0 msgr2=0x7fa074114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.605+0000 7fa07c3286c0 1 --2- 10.20.193.40:0/4288796590 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410fbf0 0x7fa074114c30 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=17090510089191301841 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0680099a0 tx=0x7fa06802ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:02.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.605+0000 7fa07c3286c0 1 -- 10.20.193.40:0/4288796590 shutdown_connections 2026-02-13T01:24:02.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.605+0000 7fa07c3286c0 1 --2- 10.20.193.40:0/4288796590 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa074115410 0x7fa074175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.605+0000 7fa07c3286c0 1 --2- 10.20.193.40:0/4288796590 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410fbf0 0x7fa074114c30 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=17090510089191301841 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.605+0000 7fa07c3286c0 1 --2- 10.20.193.40:0/4288796590 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa07410f200 0x7fa07410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.605+0000 7fa07c3286c0 1 -- 10.20.193.40:0/4288796590 >> 10.20.193.40:0/4288796590 conn(0x7fa0740ecb00 msgr2=0x7fa07410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:02.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.605+0000 7fa07c3286c0 1 -- 10.20.193.40:0/4288796590 shutdown_connections 2026-02-13T01:24:02.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.605+0000 7fa07c3286c0 1 -- 10.20.193.40:0/4288796590 wait complete. 2026-02-13T01:24:02.609 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07c3286c0 1 Processor -- start 2026-02-13T01:24:02.609 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07c3286c0 1 -- start start 2026-02-13T01:24:02.609 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07c3286c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410f200 0x7fa07411d090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.609 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07c3286c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa074115410 0x7fa07411d5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.609 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07c3286c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa074122990 0x7fa074122e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.609 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07c3286c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741233a0 con 0x7fa07410f200 2026-02-13T01:24:02.609 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07c3286c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa074123510 con 0x7fa074122990 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07c3286c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741236d0 con 0x7fa074115410 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07a09d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410f200 0x7fa07411d090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07a09d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410f200 0x7fa07411d090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33412/0 (socket says 10.20.193.40:33412) 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07a09d6c0 1 -- 10.20.193.40:0/2562997114 learned_addr learned my addr 10.20.193.40:0/2562997114 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07989c6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa074115410 0x7fa07411d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.606+0000 7fa07a89e6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa074122990 0x7fa074122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa07a09d6c0 1 -- 10.20.193.40:0/2562997114 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa074115410 msgr2=0x7fa07411d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa07a09d6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa074115410 0x7fa07411d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa07a09d6c0 1 -- 10.20.193.40:0/2562997114 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa074122990 msgr2=0x7fa074122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa07a09d6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa074122990 0x7fa074122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa07a09d6c0 1 -- 10.20.193.40:0/2562997114 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa068009590 con 0x7fa07410f200 2026-02-13T01:24:02.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa07a09d6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410f200 0x7fa07411d090 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa064005dc0 tx=0x7fa06400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:02.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa05b7fe6c0 1 -- 10.20.193.40:0/2562997114 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa064004250 con 0x7fa07410f200 2026-02-13T01:24:02.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa05b7fe6c0 1 -- 10.20.193.40:0/2562997114 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa064009070 con 0x7fa07410f200 2026-02-13T01:24:02.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa05b7fe6c0 1 -- 10.20.193.40:0/2562997114 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa0640071c0 con 0x7fa07410f200 2026-02-13T01:24:02.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa07c3286c0 1 -- 10.20.193.40:0/2562997114 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa074163b80 con 0x7fa07410f200 2026-02-13T01:24:02.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.607+0000 7fa07c3286c0 1 -- 10.20.193.40:0/2562997114 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa074164010 con 0x7fa07410f200 2026-02-13T01:24:02.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.608+0000 7fa0597fa6c0 1 -- 10.20.193.40:0/2562997114 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0741104d0 con 0x7fa07410f200 2026-02-13T01:24:02.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.610+0000 7fa05b7fe6c0 1 -- 10.20.193.40:0/2562997114 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa0640043b0 con 0x7fa07410f200 2026-02-13T01:24:02.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.612+0000 7fa05b7fe6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0500b5760 0x7fa0500d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.612+0000 7fa05b7fe6c0 1 -- 10.20.193.40:0/2562997114 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fa0640e3d30 con 0x7fa07410f200 2026-02-13T01:24:02.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.612+0000 7fa07989c6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0500b5760 0x7fa0500d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.612+0000 7fa07989c6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0500b5760 0x7fa0500d5c10 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa068005d10 tx=0x7fa068005c80 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:02.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.612+0000 7fa05b7fe6c0 1 -- 10.20.193.40:0/2562997114 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa0640a6680 con 0x7fa07410f200 2026-02-13T01:24:02.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.712+0000 7fa0597fa6c0 1 -- 10.20.193.40:0/2562997114 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa07410f5d0 con 0x7fa0500b5760 2026-02-13T01:24:02.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.715+0000 7fa05b7fe6c0 1 -- 10.20.193.40:0/2562997114 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258791 (secure 0 0 0) 0x7fa07410f5d0 con 0x7fa0500b5760 2026-02-13T01:24:02.719 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:02.721 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-13T01:24:02.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 -- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0500b5760 msgr2=0x7fa0500d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0500b5760 0x7fa0500d5c10 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa068005d10 tx=0x7fa068005c80 comp rx=0 tx=0).stop 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 -- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410f200 msgr2=0x7fa07411d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410f200 0x7fa07411d090 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa064005dc0 tx=0x7fa06400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 -- 10.20.193.40:0/2562997114 shutdown_connections 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0500b5760 0x7fa0500d5c10 unknown :-1 s=CLOSED pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa074122990 0x7fa074122e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa074115410 0x7fa07411d5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 --2- 10.20.193.40:0/2562997114 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa07410f200 0x7fa07411d090 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 -- 10.20.193.40:0/2562997114 >> 10.20.193.40:0/2562997114 conn(0x7fa0740ecb00 msgr2=0x7fa07410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:02.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 -- 10.20.193.40:0/2562997114 shutdown_connections 2026-02-13T01:24:02.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:02.718+0000 7fa0597fa6c0 1 -- 10.20.193.40:0/2562997114 wait complete. 2026-02-13T01:24:02.824 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2026-02-13T01:24:02.690353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602956,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":146,"num_read_kb":124,"num_write":323,"num_write_kb":3767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":334992,"kb_used_data":11424,"kb_used_omap":393,"kb_used_meta":322934,"kb_avail":8807703408,"statfs":{"total":9019431321600,"available":9019088289792,"internally_reserved":0,"allocated":11698176,"data_stored":6485011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":403040,"internal_metadata":330684832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12588,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":134,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.608993"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082432+0000","last_change":"2026-02-13T01:23:51.087785+0000","last_active":"2026-02-13T01:23:52.082432+0000","last_peered":"2026-02-13T01:23:52.082432+0000","last_clean":"2026-02-13T01:23:52.082432+0000","last_became_active":"2026-02-13T01:23:51.087666+0000","last_became_peered":"2026-02-13T01:23:51.087666+0000","last_unstale":"2026-02-13T01:23:52.082432+0000","last_undegraded":"2026-02-13T01:23:52.082432+0000","last_fullsized":"2026-02-13T01:23:52.082432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:35.585128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083500+0000","last_change":"2026-02-13T01:23:51.085295+0000","last_active":"2026-02-13T01:23:52.083500+0000","last_peered":"2026-02-13T01:23:52.083500+0000","last_clean":"2026-02-13T01:23:52.083500+0000","last_became_active":"2026-02-13T01:23:51.085131+0000","last_became_peered":"2026-02-13T01:23:51.085131+0000","last_unstale":"2026-02-13T01:23:52.083500+0000","last_undegraded":"2026-02-13T01:23:52.083500+0000","last_fullsized":"2026-02-13T01:23:52.083500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:18.129399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083128+0000","last_change":"2026-02-13T01:23:51.085354+0000","last_active":"2026-02-13T01:23:52.083128+0000","last_peered":"2026-02-13T01:23:52.083128+0000","last_clean":"2026-02-13T01:23:52.083128+0000","last_became_active":"2026-02-13T01:23:51.084953+0000","last_became_peered":"2026-02-13T01:23:51.084953+0000","last_unstale":"2026-02-13T01:23:52.083128+0000","last_undegraded":"2026-02-13T01:23:52.083128+0000","last_fullsized":"2026-02-13T01:23:52.083128+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:32.298388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311720+0000","last_change":"2026-02-13T01:23:51.077255+0000","last_active":"2026-02-13T01:23:52.311720+0000","last_peered":"2026-02-13T01:23:52.311720+0000","last_clean":"2026-02-13T01:23:52.311720+0000","last_became_active":"2026-02-13T01:23:51.076786+0000","last_became_peered":"2026-02-13T01:23:51.076786+0000","last_unstale":"2026-02-13T01:23:52.311720+0000","last_undegraded":"2026-02-13T01:23:52.311720+0000","last_fullsized":"2026-02-13T01:23:52.311720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:25.514019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312471+0000","last_change":"2026-02-13T01:23:51.078791+0000","last_active":"2026-02-13T01:23:52.312471+0000","last_peered":"2026-02-13T01:23:52.312471+0000","last_clean":"2026-02-13T01:23:52.312471+0000","last_became_active":"2026-02-13T01:23:51.078655+0000","last_became_peered":"2026-02-13T01:23:51.078655+0000","last_unstale":"2026-02-13T01:23:52.312471+0000","last_undegraded":"2026-02-13T01:23:52.312471+0000","last_fullsized":"2026-02-13T01:23:52.312471+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:39:11.299004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081309+0000","last_change":"2026-02-13T01:23:51.078732+0000","last_active":"2026-02-13T01:23:52.081309+0000","last_peered":"2026-02-13T01:23:52.081309+0000","last_clean":"2026-02-13T01:23:52.081309+0000","last_became_active":"2026-02-13T01:23:51.078623+0000","last_became_peered":"2026-02-13T01:23:51.078623+0000","last_unstale":"2026-02-13T01:23:52.081309+0000","last_undegraded":"2026-02-13T01:23:52.081309+0000","last_fullsized":"2026-02-13T01:23:52.081309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:44.150512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957653+0000","last_change":"2026-02-13T01:23:51.079852+0000","last_active":"2026-02-13T01:23:52.957653+0000","last_peered":"2026-02-13T01:23:52.957653+0000","last_clean":"2026-02-13T01:23:52.957653+0000","last_became_active":"2026-02-13T01:23:51.079722+0000","last_became_peered":"2026-02-13T01:23:51.079722+0000","last_unstale":"2026-02-13T01:23:52.957653+0000","last_undegraded":"2026-02-13T01:23:52.957653+0000","last_fullsized":"2026-02-13T01:23:52.957653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:05:57.521391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082415+0000","last_change":"2026-02-13T01:23:51.080431+0000","last_active":"2026-02-13T01:23:52.082415+0000","last_peered":"2026-02-13T01:23:52.082415+0000","last_clean":"2026-02-13T01:23:52.082415+0000","last_became_active":"2026-02-13T01:23:51.080137+0000","last_became_peered":"2026-02-13T01:23:51.080137+0000","last_unstale":"2026-02-13T01:23:52.082415+0000","last_undegraded":"2026-02-13T01:23:52.082415+0000","last_fullsized":"2026-02-13T01:23:52.082415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:24.824142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311585+0000","last_change":"2026-02-13T01:23:51.076636+0000","last_active":"2026-02-13T01:23:52.311585+0000","last_peered":"2026-02-13T01:23:52.311585+0000","last_clean":"2026-02-13T01:23:52.311585+0000","last_became_active":"2026-02-13T01:23:51.076457+0000","last_became_peered":"2026-02-13T01:23:51.076457+0000","last_unstale":"2026-02-13T01:23:52.311585+0000","last_undegraded":"2026-02-13T01:23:52.311585+0000","last_fullsized":"2026-02-13T01:23:52.311585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:25:35.580381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081654+0000","last_change":"2026-02-13T01:23:51.077042+0000","last_active":"2026-02-13T01:23:52.081654+0000","last_peered":"2026-02-13T01:23:52.081654+0000","last_clean":"2026-02-13T01:23:52.081654+0000","last_became_active":"2026-02-13T01:23:51.076925+0000","last_became_peered":"2026-02-13T01:23:51.076925+0000","last_unstale":"2026-02-13T01:23:52.081654+0000","last_undegraded":"2026-02-13T01:23:52.081654+0000","last_fullsized":"2026-02-13T01:23:52.081654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:24:36.245078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958059+0000","last_change":"2026-02-13T01:23:51.076945+0000","last_active":"2026-02-13T01:23:52.958059+0000","last_peered":"2026-02-13T01:23:52.958059+0000","last_clean":"2026-02-13T01:23:52.958059+0000","last_became_active":"2026-02-13T01:23:51.076801+0000","last_became_peered":"2026-02-13T01:23:51.076801+0000","last_unstale":"2026-02-13T01:23:52.958059+0000","last_undegraded":"2026-02-13T01:23:52.958059+0000","last_fullsized":"2026-02-13T01:23:52.958059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:14:06.277449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311818+0000","last_change":"2026-02-13T01:23:51.077720+0000","last_active":"2026-02-13T01:23:52.311818+0000","last_peered":"2026-02-13T01:23:52.311818+0000","last_clean":"2026-02-13T01:23:52.311818+0000","last_became_active":"2026-02-13T01:23:51.077217+0000","last_became_peered":"2026-02-13T01:23:51.077217+0000","last_unstale":"2026-02-13T01:23:52.311818+0000","last_undegraded":"2026-02-13T01:23:52.311818+0000","last_fullsized":"2026-02-13T01:23:52.311818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:33.011072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084544+0000","last_change":"2026-02-13T01:23:51.078177+0000","last_active":"2026-02-13T01:23:52.084544+0000","last_peered":"2026-02-13T01:23:52.084544+0000","last_clean":"2026-02-13T01:23:52.084544+0000","last_became_active":"2026-02-13T01:23:51.078110+0000","last_became_peered":"2026-02-13T01:23:51.078110+0000","last_unstale":"2026-02-13T01:23:52.084544+0000","last_undegraded":"2026-02-13T01:23:52.084544+0000","last_fullsized":"2026-02-13T01:23:52.084544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:59.357633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082814+0000","last_change":"2026-02-13T01:23:51.086034+0000","last_active":"2026-02-13T01:23:52.082814+0000","last_peered":"2026-02-13T01:23:52.082814+0000","last_clean":"2026-02-13T01:23:52.082814+0000","last_became_active":"2026-02-13T01:23:51.085782+0000","last_became_peered":"2026-02-13T01:23:51.085782+0000","last_unstale":"2026-02-13T01:23:52.082814+0000","last_undegraded":"2026-02-13T01:23:52.082814+0000","last_fullsized":"2026-02-13T01:23:52.082814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:28:34.185905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082761+0000","last_change":"2026-02-13T01:23:51.082750+0000","last_active":"2026-02-13T01:23:52.082761+0000","last_peered":"2026-02-13T01:23:52.082761+0000","last_clean":"2026-02-13T01:23:52.082761+0000","last_became_active":"2026-02-13T01:23:51.082533+0000","last_became_peered":"2026-02-13T01:23:51.082533+0000","last_unstale":"2026-02-13T01:23:52.082761+0000","last_undegraded":"2026-02-13T01:23:52.082761+0000","last_fullsized":"2026-02-13T01:23:52.082761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:10:33.600010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.310928+0000","last_change":"2026-02-13T01:23:51.083431+0000","last_active":"2026-02-13T01:23:52.310928+0000","last_peered":"2026-02-13T01:23:52.310928+0000","last_clean":"2026-02-13T01:23:52.310928+0000","last_became_active":"2026-02-13T01:23:51.083297+0000","last_became_peered":"2026-02-13T01:23:51.083297+0000","last_unstale":"2026-02-13T01:23:52.310928+0000","last_undegraded":"2026-02-13T01:23:52.310928+0000","last_fullsized":"2026-02-13T01:23:52.310928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:45:36.970802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082486+0000","last_change":"2026-02-13T01:23:51.087754+0000","last_active":"2026-02-13T01:23:52.082486+0000","last_peered":"2026-02-13T01:23:52.082486+0000","last_clean":"2026-02-13T01:23:52.082486+0000","last_became_active":"2026-02-13T01:23:51.087606+0000","last_became_peered":"2026-02-13T01:23:51.087606+0000","last_unstale":"2026-02-13T01:23:52.082486+0000","last_undegraded":"2026-02-13T01:23:52.082486+0000","last_fullsized":"2026-02-13T01:23:52.082486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:15.160137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084350+0000","last_change":"2026-02-13T01:23:51.082589+0000","last_active":"2026-02-13T01:23:52.084350+0000","last_peered":"2026-02-13T01:23:52.084350+0000","last_clean":"2026-02-13T01:23:52.084350+0000","last_became_active":"2026-02-13T01:23:51.081937+0000","last_became_peered":"2026-02-13T01:23:51.081937+0000","last_unstale":"2026-02-13T01:23:52.084350+0000","last_undegraded":"2026-02-13T01:23:52.084350+0000","last_fullsized":"2026-02-13T01:23:52.084350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:23:55.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312722+0000","last_change":"2026-02-13T01:23:51.083199+0000","last_active":"2026-02-13T01:23:52.312722+0000","last_peered":"2026-02-13T01:23:52.312722+0000","last_clean":"2026-02-13T01:23:52.312722+0000","last_became_active":"2026-02-13T01:23:51.083082+0000","last_became_peered":"2026-02-13T01:23:51.083082+0000","last_unstale":"2026-02-13T01:23:52.312722+0000","last_undegraded":"2026-02-13T01:23:52.312722+0000","last_fullsized":"2026-02-13T01:23:52.312722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:40:27.940964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082074+0000","last_change":"2026-02-13T01:23:51.078089+0000","last_active":"2026-02-13T01:23:52.082074+0000","last_peered":"2026-02-13T01:23:52.082074+0000","last_clean":"2026-02-13T01:23:52.082074+0000","last_became_active":"2026-02-13T01:23:51.077949+0000","last_became_peered":"2026-02-13T01:23:51.077949+0000","last_unstale":"2026-02-13T01:23:52.082074+0000","last_undegraded":"2026-02-13T01:23:52.082074+0000","last_fullsized":"2026-02-13T01:23:52.082074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:49:31.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084637+0000","last_change":"2026-02-13T01:23:51.087902+0000","last_active":"2026-02-13T01:23:52.084637+0000","last_peered":"2026-02-13T01:23:52.084637+0000","last_clean":"2026-02-13T01:23:52.084637+0000","last_became_active":"2026-02-13T01:23:51.087588+0000","last_became_peered":"2026-02-13T01:23:51.087588+0000","last_unstale":"2026-02-13T01:23:52.084637+0000","last_undegraded":"2026-02-13T01:23:52.084637+0000","last_fullsized":"2026-02-13T01:23:52.084637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:59:18.831776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311145+0000","last_change":"2026-02-13T01:23:51.082383+0000","last_active":"2026-02-13T01:23:52.311145+0000","last_peered":"2026-02-13T01:23:52.311145+0000","last_clean":"2026-02-13T01:23:52.311145+0000","last_became_active":"2026-02-13T01:23:51.082213+0000","last_became_peered":"2026-02-13T01:23:51.082213+0000","last_unstale":"2026-02-13T01:23:52.311145+0000","last_undegraded":"2026-02-13T01:23:52.311145+0000","last_fullsized":"2026-02-13T01:23:52.311145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:31:53.038095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082509+0000","last_change":"2026-02-13T01:23:51.084995+0000","last_active":"2026-02-13T01:23:52.082509+0000","last_peered":"2026-02-13T01:23:52.082509+0000","last_clean":"2026-02-13T01:23:52.082509+0000","last_became_active":"2026-02-13T01:23:51.084099+0000","last_became_peered":"2026-02-13T01:23:51.084099+0000","last_unstale":"2026-02-13T01:23:52.082509+0000","last_undegraded":"2026-02-13T01:23:52.082509+0000","last_fullsized":"2026-02-13T01:23:52.082509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:28:13.169004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081986+0000","last_change":"2026-02-13T01:23:51.079945+0000","last_active":"2026-02-13T01:23:52.081986+0000","last_peered":"2026-02-13T01:23:52.081986+0000","last_clean":"2026-02-13T01:23:52.081986+0000","last_became_active":"2026-02-13T01:23:51.079769+0000","last_became_peered":"2026-02-13T01:23:51.079769+0000","last_unstale":"2026-02-13T01:23:52.081986+0000","last_undegraded":"2026-02-13T01:23:52.081986+0000","last_fullsized":"2026-02-13T01:23:52.081986+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:35:23.092307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082900+0000","last_change":"2026-02-13T01:23:51.083623+0000","last_active":"2026-02-13T01:23:52.082900+0000","last_peered":"2026-02-13T01:23:52.082900+0000","last_clean":"2026-02-13T01:23:52.082900+0000","last_became_active":"2026-02-13T01:23:51.080812+0000","last_became_peered":"2026-02-13T01:23:51.080812+0000","last_unstale":"2026-02-13T01:23:52.082900+0000","last_undegraded":"2026-02-13T01:23:52.082900+0000","last_fullsized":"2026-02-13T01:23:52.082900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:11.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312793+0000","last_change":"2026-02-13T01:23:51.077158+0000","last_active":"2026-02-13T01:23:52.312793+0000","last_peered":"2026-02-13T01:23:52.312793+0000","last_clean":"2026-02-13T01:23:52.312793+0000","last_became_active":"2026-02-13T01:23:51.077028+0000","last_became_peered":"2026-02-13T01:23:51.077028+0000","last_unstale":"2026-02-13T01:23:52.312793+0000","last_undegraded":"2026-02-13T01:23:52.312793+0000","last_fullsized":"2026-02-13T01:23:52.312793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:58:04.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082315+0000","last_change":"2026-02-13T01:23:51.077585+0000","last_active":"2026-02-13T01:23:52.082315+0000","last_peered":"2026-02-13T01:23:52.082315+0000","last_clean":"2026-02-13T01:23:52.082315+0000","last_became_active":"2026-02-13T01:23:51.077411+0000","last_became_peered":"2026-02-13T01:23:51.077411+0000","last_unstale":"2026-02-13T01:23:52.082315+0000","last_undegraded":"2026-02-13T01:23:52.082315+0000","last_fullsized":"2026-02-13T01:23:52.082315+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:08.469350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084548+0000","last_change":"2026-02-13T01:23:51.087500+0000","last_active":"2026-02-13T01:23:52.084548+0000","last_peered":"2026-02-13T01:23:52.084548+0000","last_clean":"2026-02-13T01:23:52.084548+0000","last_became_active":"2026-02-13T01:23:51.087400+0000","last_became_peered":"2026-02-13T01:23:51.087400+0000","last_unstale":"2026-02-13T01:23:52.084548+0000","last_undegraded":"2026-02-13T01:23:52.084548+0000","last_fullsized":"2026-02-13T01:23:52.084548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:39.858050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083032+0000","last_change":"2026-02-13T01:23:51.086351+0000","last_active":"2026-02-13T01:23:52.083032+0000","last_peered":"2026-02-13T01:23:52.083032+0000","last_clean":"2026-02-13T01:23:52.083032+0000","last_became_active":"2026-02-13T01:23:51.086196+0000","last_became_peered":"2026-02-13T01:23:51.086196+0000","last_unstale":"2026-02-13T01:23:52.083032+0000","last_undegraded":"2026-02-13T01:23:52.083032+0000","last_fullsized":"2026-02-13T01:23:52.083032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:20:51.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312466+0000","last_change":"2026-02-13T01:23:51.086663+0000","last_active":"2026-02-13T01:23:52.312466+0000","last_peered":"2026-02-13T01:23:52.312466+0000","last_clean":"2026-02-13T01:23:52.312466+0000","last_became_active":"2026-02-13T01:23:51.086549+0000","last_became_peered":"2026-02-13T01:23:51.086549+0000","last_unstale":"2026-02-13T01:23:52.312466+0000","last_undegraded":"2026-02-13T01:23:52.312466+0000","last_fullsized":"2026-02-13T01:23:52.312466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:08.297213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312479+0000","last_change":"2026-02-13T01:23:51.079493+0000","last_active":"2026-02-13T01:23:52.312479+0000","last_peered":"2026-02-13T01:23:52.312479+0000","last_clean":"2026-02-13T01:23:52.312479+0000","last_became_active":"2026-02-13T01:23:51.079217+0000","last_became_peered":"2026-02-13T01:23:51.079217+0000","last_unstale":"2026-02-13T01:23:52.312479+0000","last_undegraded":"2026-02-13T01:23:52.312479+0000","last_fullsized":"2026-02-13T01:23:52.312479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:30:24.298223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081960+0000","last_change":"2026-02-13T01:23:51.079378+0000","last_active":"2026-02-13T01:23:52.081960+0000","last_peered":"2026-02-13T01:23:52.081960+0000","last_clean":"2026-02-13T01:23:52.081960+0000","last_became_active":"2026-02-13T01:23:51.079184+0000","last_became_peered":"2026-02-13T01:23:51.079184+0000","last_unstale":"2026-02-13T01:23:52.081960+0000","last_undegraded":"2026-02-13T01:23:52.081960+0000","last_fullsized":"2026-02-13T01:23:52.081960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:28:10.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312491+0000","last_change":"2026-02-13T01:23:51.079975+0000","last_active":"2026-02-13T01:23:52.312491+0000","last_peered":"2026-02-13T01:23:52.312491+0000","last_clean":"2026-02-13T01:23:52.312491+0000","last_became_active":"2026-02-13T01:23:51.079841+0000","last_became_peered":"2026-02-13T01:23:51.079841+0000","last_unstale":"2026-02-13T01:23:52.312491+0000","last_undegraded":"2026-02-13T01:23:52.312491+0000","last_fullsized":"2026-02-13T01:23:52.312491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:28.275600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:58.111330+0000","last_change":"2026-02-13T01:23:50.314202+0000","last_active":"2026-02-13T01:23:58.111330+0000","last_peered":"2026-02-13T01:23:58.111330+0000","last_clean":"2026-02-13T01:23:58.111330+0000","last_became_active":"2026-02-13T01:23:50.313965+0000","last_became_peered":"2026-02-13T01:23:50.313965+0000","last_unstale":"2026-02-13T01:23:58.111330+0000","last_undegraded":"2026-02-13T01:23:58.111330+0000","last_fullsized":"2026-02-13T01:23:58.111330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:58:16.283974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082398+0000","last_change":"2026-02-13T01:23:51.083970+0000","last_active":"2026-02-13T01:23:52.082398+0000","last_peered":"2026-02-13T01:23:52.082398+0000","last_clean":"2026-02-13T01:23:52.082398+0000","last_became_active":"2026-02-13T01:23:51.083823+0000","last_became_peered":"2026-02-13T01:23:51.083823+0000","last_unstale":"2026-02-13T01:23:52.082398+0000","last_undegraded":"2026-02-13T01:23:52.082398+0000","last_fullsized":"2026-02-13T01:23:52.082398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:18:40.333939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103253+0000","last_change":"2026-02-13T01:23:50.315973+0000","last_active":"2026-02-13T01:23:56.103253+0000","last_peered":"2026-02-13T01:23:56.103253+0000","last_clean":"2026-02-13T01:23:56.103253+0000","last_became_active":"2026-02-13T01:23:50.315798+0000","last_became_peered":"2026-02-13T01:23:50.315798+0000","last_unstale":"2026-02-13T01:23:56.103253+0000","last_undegraded":"2026-02-13T01:23:56.103253+0000","last_fullsized":"2026-02-13T01:23:56.103253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:40.079951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.108656+0000","last_change":"2026-02-13T01:23:50.321711+0000","last_active":"2026-02-13T01:23:56.108656+0000","last_peered":"2026-02-13T01:23:56.108656+0000","last_clean":"2026-02-13T01:23:56.108656+0000","last_became_active":"2026-02-13T01:23:50.320547+0000","last_became_peered":"2026-02-13T01:23:50.320547+0000","last_unstale":"2026-02-13T01:23:56.108656+0000","last_undegraded":"2026-02-13T01:23:56.108656+0000","last_fullsized":"2026-02-13T01:23:56.108656+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:07.279129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084082+0000","last_change":"2026-02-13T01:23:51.079484+0000","last_active":"2026-02-13T01:23:52.084082+0000","last_peered":"2026-02-13T01:23:52.084082+0000","last_clean":"2026-02-13T01:23:52.084082+0000","last_became_active":"2026-02-13T01:23:51.079364+0000","last_became_peered":"2026-02-13T01:23:51.079364+0000","last_unstale":"2026-02-13T01:23:52.084082+0000","last_undegraded":"2026-02-13T01:23:52.084082+0000","last_fullsized":"2026-02-13T01:23:52.084082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:46:25.508752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:53.519478+0000","last_change":"2026-02-13T01:23:50.313889+0000","last_active":"2026-02-13T01:23:53.519478+0000","last_peered":"2026-02-13T01:23:53.519478+0000","last_clean":"2026-02-13T01:23:53.519478+0000","last_became_active":"2026-02-13T01:23:50.313686+0000","last_became_peered":"2026-02-13T01:23:50.313686+0000","last_unstale":"2026-02-13T01:23:53.519478+0000","last_undegraded":"2026-02-13T01:23:53.519478+0000","last_fullsized":"2026-02-13T01:23:53.519478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:06.306071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084282+0000","last_change":"2026-02-13T01:23:51.085261+0000","last_active":"2026-02-13T01:23:52.084282+0000","last_peered":"2026-02-13T01:23:52.084282+0000","last_clean":"2026-02-13T01:23:52.084282+0000","last_became_active":"2026-02-13T01:23:51.085174+0000","last_became_peered":"2026-02-13T01:23:51.085174+0000","last_unstale":"2026-02-13T01:23:52.084282+0000","last_undegraded":"2026-02-13T01:23:52.084282+0000","last_fullsized":"2026-02-13T01:23:52.084282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:22:06.653604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100986+0000","last_change":"2026-02-13T01:23:50.319556+0000","last_active":"2026-02-13T01:23:55.100986+0000","last_peered":"2026-02-13T01:23:55.100986+0000","last_clean":"2026-02-13T01:23:55.100986+0000","last_became_active":"2026-02-13T01:23:50.319416+0000","last_became_peered":"2026-02-13T01:23:50.319416+0000","last_unstale":"2026-02-13T01:23:55.100986+0000","last_undegraded":"2026-02-13T01:23:55.100986+0000","last_fullsized":"2026-02-13T01:23:55.100986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:21:13.508452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311504+0000","last_change":"2026-02-13T01:23:51.080630+0000","last_active":"2026-02-13T01:23:52.311504+0000","last_peered":"2026-02-13T01:23:52.311504+0000","last_clean":"2026-02-13T01:23:52.311504+0000","last_became_active":"2026-02-13T01:23:51.080523+0000","last_became_peered":"2026-02-13T01:23:51.080523+0000","last_unstale":"2026-02-13T01:23:52.311504+0000","last_undegraded":"2026-02-13T01:23:52.311504+0000","last_fullsized":"2026-02-13T01:23:52.311504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:31:27.515871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.099151+0000","last_change":"2026-02-13T01:23:50.313353+0000","last_active":"2026-02-13T01:23:55.099151+0000","last_peered":"2026-02-13T01:23:55.099151+0000","last_clean":"2026-02-13T01:23:55.099151+0000","last_became_active":"2026-02-13T01:23:50.312960+0000","last_became_peered":"2026-02-13T01:23:50.312960+0000","last_unstale":"2026-02-13T01:23:55.099151+0000","last_undegraded":"2026-02-13T01:23:55.099151+0000","last_fullsized":"2026-02-13T01:23:55.099151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:17.457348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083218+0000","last_change":"2026-02-13T01:23:51.085556+0000","last_active":"2026-02-13T01:23:52.083218+0000","last_peered":"2026-02-13T01:23:52.083218+0000","last_clean":"2026-02-13T01:23:52.083218+0000","last_became_active":"2026-02-13T01:23:51.084737+0000","last_became_peered":"2026-02-13T01:23:51.084737+0000","last_unstale":"2026-02-13T01:23:52.083218+0000","last_undegraded":"2026-02-13T01:23:52.083218+0000","last_fullsized":"2026-02-13T01:23:52.083218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:34.732291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.102259+0000","last_change":"2026-02-13T01:23:50.314013+0000","last_active":"2026-02-13T01:23:55.102259+0000","last_peered":"2026-02-13T01:23:55.102259+0000","last_clean":"2026-02-13T01:23:55.102259+0000","last_became_active":"2026-02-13T01:23:50.313750+0000","last_became_peered":"2026-02-13T01:23:50.313750+0000","last_unstale":"2026-02-13T01:23:55.102259+0000","last_undegraded":"2026-02-13T01:23:55.102259+0000","last_fullsized":"2026-02-13T01:23:55.102259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:11.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311298+0000","last_change":"2026-02-13T01:23:51.078331+0000","last_active":"2026-02-13T01:23:52.311298+0000","last_peered":"2026-02-13T01:23:52.311298+0000","last_clean":"2026-02-13T01:23:52.311298+0000","last_became_active":"2026-02-13T01:23:51.078107+0000","last_became_peered":"2026-02-13T01:23:51.078107+0000","last_unstale":"2026-02-13T01:23:52.311298+0000","last_undegraded":"2026-02-13T01:23:52.311298+0000","last_fullsized":"2026-02-13T01:23:52.311298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:01.797388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'11","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.718863+0000","last_change":"2026-02-13T01:23:50.312858+0000","last_active":"2026-02-13T01:23:57.718863+0000","last_peered":"2026-02-13T01:23:57.718863+0000","last_clean":"2026-02-13T01:23:57.718863+0000","last_became_active":"2026-02-13T01:23:50.312641+0000","last_became_peered":"2026-02-13T01:23:50.312641+0000","last_unstale":"2026-02-13T01:23:57.718863+0000","last_undegraded":"2026-02-13T01:23:57.718863+0000","last_fullsized":"2026-02-13T01:23:57.718863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:14.572231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312665+0000","last_change":"2026-02-13T01:23:51.077407+0000","last_active":"2026-02-13T01:23:52.312665+0000","last_peered":"2026-02-13T01:23:52.312665+0000","last_clean":"2026-02-13T01:23:52.312665+0000","last_became_active":"2026-02-13T01:23:51.077180+0000","last_became_peered":"2026-02-13T01:23:51.077180+0000","last_unstale":"2026-02-13T01:23:52.312665+0000","last_undegraded":"2026-02-13T01:23:52.312665+0000","last_fullsized":"2026-02-13T01:23:52.312665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:40:00.558376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104764+0000","last_change":"2026-02-13T01:23:50.313114+0000","last_active":"2026-02-13T01:23:56.104764+0000","last_peered":"2026-02-13T01:23:56.104764+0000","last_clean":"2026-02-13T01:23:56.104764+0000","last_became_active":"2026-02-13T01:23:50.312955+0000","last_became_peered":"2026-02-13T01:23:50.312955+0000","last_unstale":"2026-02-13T01:23:56.104764+0000","last_undegraded":"2026-02-13T01:23:56.104764+0000","last_fullsized":"2026-02-13T01:23:56.104764+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:48:28.664538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084295+0000","last_change":"2026-02-13T01:23:51.087820+0000","last_active":"2026-02-13T01:23:52.084295+0000","last_peered":"2026-02-13T01:23:52.084295+0000","last_clean":"2026-02-13T01:23:52.084295+0000","last_became_active":"2026-02-13T01:23:51.087642+0000","last_became_peered":"2026-02-13T01:23:51.087642+0000","last_unstale":"2026-02-13T01:23:52.084295+0000","last_undegraded":"2026-02-13T01:23:52.084295+0000","last_fullsized":"2026-02-13T01:23:52.084295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:53:35.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.101071+0000","last_change":"2026-02-13T01:23:50.317064+0000","last_active":"2026-02-13T01:23:55.101071+0000","last_peered":"2026-02-13T01:23:55.101071+0000","last_clean":"2026-02-13T01:23:55.101071+0000","last_became_active":"2026-02-13T01:23:50.316871+0000","last_became_peered":"2026-02-13T01:23:50.316871+0000","last_unstale":"2026-02-13T01:23:55.101071+0000","last_undegraded":"2026-02-13T01:23:55.101071+0000","last_fullsized":"2026-02-13T01:23:55.101071+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:16.140406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957948+0000","last_change":"2026-02-13T01:23:51.076041+0000","last_active":"2026-02-13T01:23:52.957948+0000","last_peered":"2026-02-13T01:23:52.957948+0000","last_clean":"2026-02-13T01:23:52.957948+0000","last_became_active":"2026-02-13T01:23:51.075750+0000","last_became_peered":"2026-02-13T01:23:51.075750+0000","last_unstale":"2026-02-13T01:23:52.957948+0000","last_undegraded":"2026-02-13T01:23:52.957948+0000","last_fullsized":"2026-02-13T01:23:52.957948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:37:15.723754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:59.111359+0000","last_change":"2026-02-13T01:23:50.312631+0000","last_active":"2026-02-13T01:23:59.111359+0000","last_peered":"2026-02-13T01:23:59.111359+0000","last_clean":"2026-02-13T01:23:59.111359+0000","last_became_active":"2026-02-13T01:23:50.312445+0000","last_became_peered":"2026-02-13T01:23:50.312445+0000","last_unstale":"2026-02-13T01:23:59.111359+0000","last_undegraded":"2026-02-13T01:23:59.111359+0000","last_fullsized":"2026-02-13T01:23:59.111359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:40.527470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957625+0000","last_change":"2026-02-13T01:23:51.078230+0000","last_active":"2026-02-13T01:23:52.957625+0000","last_peered":"2026-02-13T01:23:52.957625+0000","last_clean":"2026-02-13T01:23:52.957625+0000","last_became_active":"2026-02-13T01:23:51.078113+0000","last_became_peered":"2026-02-13T01:23:51.078113+0000","last_unstale":"2026-02-13T01:23:52.957625+0000","last_undegraded":"2026-02-13T01:23:52.957625+0000","last_fullsized":"2026-02-13T01:23:52.957625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:09.649368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104938+0000","last_change":"2026-02-13T01:23:50.314144+0000","last_active":"2026-02-13T01:23:56.104938+0000","last_peered":"2026-02-13T01:23:56.104938+0000","last_clean":"2026-02-13T01:23:56.104938+0000","last_became_active":"2026-02-13T01:23:50.313897+0000","last_became_peered":"2026-02-13T01:23:50.313897+0000","last_unstale":"2026-02-13T01:23:56.104938+0000","last_undegraded":"2026-02-13T01:23:56.104938+0000","last_fullsized":"2026-02-13T01:23:56.104938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:36:50.923122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082071+0000","last_change":"2026-02-13T01:23:51.078401+0000","last_active":"2026-02-13T01:23:52.082071+0000","last_peered":"2026-02-13T01:23:52.082071+0000","last_clean":"2026-02-13T01:23:52.082071+0000","last_became_active":"2026-02-13T01:23:51.078113+0000","last_became_peered":"2026-02-13T01:23:51.078113+0000","last_unstale":"2026-02-13T01:23:52.082071+0000","last_undegraded":"2026-02-13T01:23:52.082071+0000","last_fullsized":"2026-02-13T01:23:52.082071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:38:58.059781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.108405+0000","last_change":"2026-02-13T01:23:50.311883+0000","last_active":"2026-02-13T01:23:57.108405+0000","last_peered":"2026-02-13T01:23:57.108405+0000","last_clean":"2026-02-13T01:23:57.108405+0000","last_became_active":"2026-02-13T01:23:50.311677+0000","last_became_peered":"2026-02-13T01:23:50.311677+0000","last_unstale":"2026-02-13T01:23:57.108405+0000","last_undegraded":"2026-02-13T01:23:57.108405+0000","last_fullsized":"2026-02-13T01:23:57.108405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:03:41.688088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082293+0000","last_change":"2026-02-13T01:23:51.077302+0000","last_active":"2026-02-13T01:23:52.082293+0000","last_peered":"2026-02-13T01:23:52.082293+0000","last_clean":"2026-02-13T01:23:52.082293+0000","last_became_active":"2026-02-13T01:23:51.077062+0000","last_became_peered":"2026-02-13T01:23:51.077062+0000","last_unstale":"2026-02-13T01:23:52.082293+0000","last_undegraded":"2026-02-13T01:23:52.082293+0000","last_fullsized":"2026-02-13T01:23:52.082293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:29:19.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084451+0000","last_change":"2026-02-13T01:23:50.318138+0000","last_active":"2026-02-13T01:23:52.084451+0000","last_peered":"2026-02-13T01:23:52.084451+0000","last_clean":"2026-02-13T01:23:52.084451+0000","last_became_active":"2026-02-13T01:23:50.318046+0000","last_became_peered":"2026-02-13T01:23:50.318046+0000","last_unstale":"2026-02-13T01:23:52.084451+0000","last_undegraded":"2026-02-13T01:23:52.084451+0000","last_fullsized":"2026-02-13T01:23:52.084451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:08:08.981534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958104+0000","last_change":"2026-02-13T01:23:51.076583+0000","last_active":"2026-02-13T01:23:52.958104+0000","last_peered":"2026-02-13T01:23:52.958104+0000","last_clean":"2026-02-13T01:23:52.958104+0000","last_became_active":"2026-02-13T01:23:51.076410+0000","last_became_peered":"2026-02-13T01:23:51.076410+0000","last_unstale":"2026-02-13T01:23:52.958104+0000","last_undegraded":"2026-02-13T01:23:52.958104+0000","last_fullsized":"2026-02-13T01:23:52.958104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:32.267216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:53.519536+0000","last_change":"2026-02-13T01:23:50.314790+0000","last_active":"2026-02-13T01:23:53.519536+0000","last_peered":"2026-02-13T01:23:53.519536+0000","last_clean":"2026-02-13T01:23:53.519536+0000","last_became_active":"2026-02-13T01:23:50.314648+0000","last_became_peered":"2026-02-13T01:23:50.314648+0000","last_unstale":"2026-02-13T01:23:53.519536+0000","last_undegraded":"2026-02-13T01:23:53.519536+0000","last_fullsized":"2026-02-13T01:23:53.519536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:07:25.610347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958069+0000","last_change":"2026-02-13T01:23:51.078869+0000","last_active":"2026-02-13T01:23:52.958069+0000","last_peered":"2026-02-13T01:23:52.958069+0000","last_clean":"2026-02-13T01:23:52.958069+0000","last_became_active":"2026-02-13T01:23:51.078734+0000","last_became_peered":"2026-02-13T01:23:51.078734+0000","last_unstale":"2026-02-13T01:23:52.958069+0000","last_undegraded":"2026-02-13T01:23:52.958069+0000","last_fullsized":"2026-02-13T01:23:52.958069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:14:50.870485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104919+0000","last_change":"2026-02-13T01:23:50.316821+0000","last_active":"2026-02-13T01:23:56.104919+0000","last_peered":"2026-02-13T01:23:56.104919+0000","last_clean":"2026-02-13T01:23:56.104919+0000","last_became_active":"2026-02-13T01:23:50.316669+0000","last_became_peered":"2026-02-13T01:23:50.316669+0000","last_unstale":"2026-02-13T01:23:56.104919+0000","last_undegraded":"2026-02-13T01:23:56.104919+0000","last_fullsized":"2026-02-13T01:23:56.104919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:52:17.159425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958080+0000","last_change":"2026-02-13T01:23:51.076521+0000","last_active":"2026-02-13T01:23:52.958080+0000","last_peered":"2026-02-13T01:23:52.958080+0000","last_clean":"2026-02-13T01:23:52.958080+0000","last_became_active":"2026-02-13T01:23:51.076219+0000","last_became_peered":"2026-02-13T01:23:51.076219+0000","last_unstale":"2026-02-13T01:23:52.958080+0000","last_undegraded":"2026-02-13T01:23:52.958080+0000","last_fullsized":"2026-02-13T01:23:52.958080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:10:05.735481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":345,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957697+0000","last_change":"2026-02-13T01:23:25.213241+0000","last_active":"2026-02-13T01:23:52.957697+0000","last_peered":"2026-02-13T01:23:52.957697+0000","last_clean":"2026-02-13T01:23:52.957697+0000","last_became_active":"2026-02-13T01:23:25.213096+0000","last_became_peered":"2026-02-13T01:23:25.213096+0000","last_unstale":"2026-02-13T01:23:52.957697+0000","last_undegraded":"2026-02-13T01:23:52.957697+0000","last_fullsized":"2026-02-13T01:23:52.957697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:22:12.252296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:22:12.252296+0000","last_clean_scrub_stamp":"2026-02-13T01:22:12.252296+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:12:54.951823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.108146+0000","last_change":"2026-02-13T01:23:50.318186+0000","last_active":"2026-02-13T01:23:57.108146+0000","last_peered":"2026-02-13T01:23:57.108146+0000","last_clean":"2026-02-13T01:23:57.108146+0000","last_became_active":"2026-02-13T01:23:50.318061+0000","last_became_peered":"2026-02-13T01:23:50.318061+0000","last_unstale":"2026-02-13T01:23:57.108146+0000","last_undegraded":"2026-02-13T01:23:57.108146+0000","last_fullsized":"2026-02-13T01:23:57.108146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:10:10.620620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082418+0000","last_change":"2026-02-13T01:23:51.085525+0000","last_active":"2026-02-13T01:23:52.082418+0000","last_peered":"2026-02-13T01:23:52.082418+0000","last_clean":"2026-02-13T01:23:52.082418+0000","last_became_active":"2026-02-13T01:23:51.084975+0000","last_became_peered":"2026-02-13T01:23:51.084975+0000","last_unstale":"2026-02-13T01:23:52.082418+0000","last_undegraded":"2026-02-13T01:23:52.082418+0000","last_fullsized":"2026-02-13T01:23:52.082418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:01:08.986008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103570+0000","last_change":"2026-02-13T01:23:50.313460+0000","last_active":"2026-02-13T01:23:56.103570+0000","last_peered":"2026-02-13T01:23:56.103570+0000","last_clean":"2026-02-13T01:23:56.103570+0000","last_became_active":"2026-02-13T01:23:50.313104+0000","last_became_peered":"2026-02-13T01:23:50.313104+0000","last_unstale":"2026-02-13T01:23:56.103570+0000","last_undegraded":"2026-02-13T01:23:56.103570+0000","last_fullsized":"2026-02-13T01:23:56.103570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:52:48.495789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082426+0000","last_change":"2026-02-13T01:23:51.078650+0000","last_active":"2026-02-13T01:23:52.082426+0000","last_peered":"2026-02-13T01:23:52.082426+0000","last_clean":"2026-02-13T01:23:52.082426+0000","last_became_active":"2026-02-13T01:23:51.078574+0000","last_became_peered":"2026-02-13T01:23:51.078574+0000","last_unstale":"2026-02-13T01:23:52.082426+0000","last_undegraded":"2026-02-13T01:23:52.082426+0000","last_fullsized":"2026-02-13T01:23:52.082426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:06.316722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.110453+0000","last_change":"2026-02-13T01:23:50.319269+0000","last_active":"2026-02-13T01:23:57.110453+0000","last_peered":"2026-02-13T01:23:57.110453+0000","last_clean":"2026-02-13T01:23:57.110453+0000","last_became_active":"2026-02-13T01:23:50.319131+0000","last_became_peered":"2026-02-13T01:23:50.319131+0000","last_unstale":"2026-02-13T01:23:57.110453+0000","last_undegraded":"2026-02-13T01:23:57.110453+0000","last_fullsized":"2026-02-13T01:23:57.110453+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:44:36.267282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081966+0000","last_change":"2026-02-13T01:23:51.079014+0000","last_active":"2026-02-13T01:23:52.081966+0000","last_peered":"2026-02-13T01:23:52.081966+0000","last_clean":"2026-02-13T01:23:52.081966+0000","last_became_active":"2026-02-13T01:23:51.078573+0000","last_became_peered":"2026-02-13T01:23:51.078573+0000","last_unstale":"2026-02-13T01:23:52.081966+0000","last_undegraded":"2026-02-13T01:23:52.081966+0000","last_fullsized":"2026-02-13T01:23:52.081966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:32:44.455948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957935+0000","last_change":"2026-02-13T01:23:50.317728+0000","last_active":"2026-02-13T01:23:52.957935+0000","last_peered":"2026-02-13T01:23:52.957935+0000","last_clean":"2026-02-13T01:23:52.957935+0000","last_became_active":"2026-02-13T01:23:50.317565+0000","last_became_peered":"2026-02-13T01:23:50.317565+0000","last_unstale":"2026-02-13T01:23:52.957935+0000","last_undegraded":"2026-02-13T01:23:52.957935+0000","last_fullsized":"2026-02-13T01:23:52.957935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:12:48.426265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081343+0000","last_change":"2026-02-13T01:23:51.085691+0000","last_active":"2026-02-13T01:23:52.081343+0000","last_peered":"2026-02-13T01:23:52.081343+0000","last_clean":"2026-02-13T01:23:52.081343+0000","last_became_active":"2026-02-13T01:23:51.085545+0000","last_became_peered":"2026-02-13T01:23:51.085545+0000","last_unstale":"2026-02-13T01:23:52.081343+0000","last_undegraded":"2026-02-13T01:23:52.081343+0000","last_fullsized":"2026-02-13T01:23:52.081343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:23.233907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084229+0000","last_change":"2026-02-13T01:23:50.320080+0000","last_active":"2026-02-13T01:23:52.084229+0000","last_peered":"2026-02-13T01:23:52.084229+0000","last_clean":"2026-02-13T01:23:52.084229+0000","last_became_active":"2026-02-13T01:23:50.319075+0000","last_became_peered":"2026-02-13T01:23:50.319075+0000","last_unstale":"2026-02-13T01:23:52.084229+0000","last_undegraded":"2026-02-13T01:23:52.084229+0000","last_fullsized":"2026-02-13T01:23:52.084229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:58:22.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081431+0000","last_change":"2026-02-13T01:23:51.082738+0000","last_active":"2026-02-13T01:23:52.081431+0000","last_peered":"2026-02-13T01:23:52.081431+0000","last_clean":"2026-02-13T01:23:52.081431+0000","last_became_active":"2026-02-13T01:23:51.082642+0000","last_became_peered":"2026-02-13T01:23:51.082642+0000","last_unstale":"2026-02-13T01:23:52.081431+0000","last_undegraded":"2026-02-13T01:23:52.081431+0000","last_fullsized":"2026-02-13T01:23:52.081431+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:21.938336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.101867+0000","last_change":"2026-02-13T01:23:50.319590+0000","last_active":"2026-02-13T01:23:55.101867+0000","last_peered":"2026-02-13T01:23:55.101867+0000","last_clean":"2026-02-13T01:23:55.101867+0000","last_became_active":"2026-02-13T01:23:50.319400+0000","last_became_peered":"2026-02-13T01:23:50.319400+0000","last_unstale":"2026-02-13T01:23:55.101867+0000","last_undegraded":"2026-02-13T01:23:55.101867+0000","last_fullsized":"2026-02-13T01:23:55.101867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:09:14.320587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084625+0000","last_change":"2026-02-13T01:23:51.086949+0000","last_active":"2026-02-13T01:23:52.084625+0000","last_peered":"2026-02-13T01:23:52.084625+0000","last_clean":"2026-02-13T01:23:52.084625+0000","last_became_active":"2026-02-13T01:23:51.083288+0000","last_became_peered":"2026-02-13T01:23:51.083288+0000","last_unstale":"2026-02-13T01:23:52.084625+0000","last_undegraded":"2026-02-13T01:23:52.084625+0000","last_fullsized":"2026-02-13T01:23:52.084625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:49:21.017914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'5","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:58.312410+0000","last_change":"2026-02-13T01:23:50.321788+0000","last_active":"2026-02-13T01:23:58.312410+0000","last_peered":"2026-02-13T01:23:58.312410+0000","last_clean":"2026-02-13T01:23:58.312410+0000","last_became_active":"2026-02-13T01:23:50.321507+0000","last_became_peered":"2026-02-13T01:23:50.321507+0000","last_unstale":"2026-02-13T01:23:58.312410+0000","last_undegraded":"2026-02-13T01:23:58.312410+0000","last_fullsized":"2026-02-13T01:23:58.312410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:05:53.096866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082956+0000","last_change":"2026-02-13T01:23:51.080914+0000","last_active":"2026-02-13T01:23:52.082956+0000","last_peered":"2026-02-13T01:23:52.082956+0000","last_clean":"2026-02-13T01:23:52.082956+0000","last_became_active":"2026-02-13T01:23:51.080613+0000","last_became_peered":"2026-02-13T01:23:51.080613+0000","last_unstale":"2026-02-13T01:23:52.082956+0000","last_undegraded":"2026-02-13T01:23:52.082956+0000","last_fullsized":"2026-02-13T01:23:52.082956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:27:22.311625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.098873+0000","last_change":"2026-02-13T01:23:50.317704+0000","last_active":"2026-02-13T01:23:55.098873+0000","last_peered":"2026-02-13T01:23:55.098873+0000","last_clean":"2026-02-13T01:23:55.098873+0000","last_became_active":"2026-02-13T01:23:50.317518+0000","last_became_peered":"2026-02-13T01:23:50.317518+0000","last_unstale":"2026-02-13T01:23:55.098873+0000","last_undegraded":"2026-02-13T01:23:55.098873+0000","last_fullsized":"2026-02-13T01:23:55.098873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:32:42.982192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083552+0000","last_change":"2026-02-13T01:23:51.082748+0000","last_active":"2026-02-13T01:23:52.083552+0000","last_peered":"2026-02-13T01:23:52.083552+0000","last_clean":"2026-02-13T01:23:52.083552+0000","last_became_active":"2026-02-13T01:23:51.082558+0000","last_became_peered":"2026-02-13T01:23:51.082558+0000","last_unstale":"2026-02-13T01:23:52.083552+0000","last_undegraded":"2026-02-13T01:23:52.083552+0000","last_fullsized":"2026-02-13T01:23:52.083552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:59:02.330871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100274+0000","last_change":"2026-02-13T01:23:50.316483+0000","last_active":"2026-02-13T01:23:55.100274+0000","last_peered":"2026-02-13T01:23:55.100274+0000","last_clean":"2026-02-13T01:23:55.100274+0000","last_became_active":"2026-02-13T01:23:50.316364+0000","last_became_peered":"2026-02-13T01:23:50.316364+0000","last_unstale":"2026-02-13T01:23:55.100274+0000","last_undegraded":"2026-02-13T01:23:55.100274+0000","last_fullsized":"2026-02-13T01:23:55.100274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:59:40.790096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312297+0000","last_change":"2026-02-13T01:23:51.077851+0000","last_active":"2026-02-13T01:23:52.312297+0000","last_peered":"2026-02-13T01:23:52.312297+0000","last_clean":"2026-02-13T01:23:52.312297+0000","last_became_active":"2026-02-13T01:23:51.077601+0000","last_became_peered":"2026-02-13T01:23:51.077601+0000","last_unstale":"2026-02-13T01:23:52.312297+0000","last_undegraded":"2026-02-13T01:23:52.312297+0000","last_fullsized":"2026-02-13T01:23:52.312297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:12.303405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.102650+0000","last_change":"2026-02-13T01:23:50.320431+0000","last_active":"2026-02-13T01:23:55.102650+0000","last_peered":"2026-02-13T01:23:55.102650+0000","last_clean":"2026-02-13T01:23:55.102650+0000","last_became_active":"2026-02-13T01:23:50.320143+0000","last_became_peered":"2026-02-13T01:23:50.320143+0000","last_unstale":"2026-02-13T01:23:55.102650+0000","last_undegraded":"2026-02-13T01:23:55.102650+0000","last_fullsized":"2026-02-13T01:23:55.102650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:33:25.290532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082293+0000","last_change":"2026-02-13T01:23:51.084550+0000","last_active":"2026-02-13T01:23:52.082293+0000","last_peered":"2026-02-13T01:23:52.082293+0000","last_clean":"2026-02-13T01:23:52.082293+0000","last_became_active":"2026-02-13T01:23:51.084383+0000","last_became_peered":"2026-02-13T01:23:51.084383+0000","last_unstale":"2026-02-13T01:23:52.082293+0000","last_undegraded":"2026-02-13T01:23:52.082293+0000","last_fullsized":"2026-02-13T01:23:52.082293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:04:28.333381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.974521+0000","last_change":"2026-02-13T01:23:50.317598+0000","last_active":"2026-02-13T01:23:52.974521+0000","last_peered":"2026-02-13T01:23:52.974521+0000","last_clean":"2026-02-13T01:23:52.974521+0000","last_became_active":"2026-02-13T01:23:50.317423+0000","last_became_peered":"2026-02-13T01:23:50.317423+0000","last_unstale":"2026-02-13T01:23:52.974521+0000","last_undegraded":"2026-02-13T01:23:52.974521+0000","last_fullsized":"2026-02-13T01:23:52.974521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:59:04.861370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082998+0000","last_change":"2026-02-13T01:23:51.086322+0000","last_active":"2026-02-13T01:23:52.082998+0000","last_peered":"2026-02-13T01:23:52.082998+0000","last_clean":"2026-02-13T01:23:52.082998+0000","last_became_active":"2026-02-13T01:23:51.086198+0000","last_became_peered":"2026-02-13T01:23:51.086198+0000","last_unstale":"2026-02-13T01:23:52.082998+0000","last_undegraded":"2026-02-13T01:23:52.082998+0000","last_fullsized":"2026-02-13T01:23:52.082998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:59.547632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100675+0000","last_change":"2026-02-13T01:23:50.313658+0000","last_active":"2026-02-13T01:23:55.100675+0000","last_peered":"2026-02-13T01:23:55.100675+0000","last_clean":"2026-02-13T01:23:55.100675+0000","last_became_active":"2026-02-13T01:23:50.313515+0000","last_became_peered":"2026-02-13T01:23:50.313515+0000","last_unstale":"2026-02-13T01:23:55.100675+0000","last_undegraded":"2026-02-13T01:23:55.100675+0000","last_fullsized":"2026-02-13T01:23:55.100675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:17.507776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957957+0000","last_change":"2026-02-13T01:23:51.075832+0000","last_active":"2026-02-13T01:23:52.957957+0000","last_peered":"2026-02-13T01:23:52.957957+0000","last_clean":"2026-02-13T01:23:52.957957+0000","last_became_active":"2026-02-13T01:23:51.075617+0000","last_became_peered":"2026-02-13T01:23:51.075617+0000","last_unstale":"2026-02-13T01:23:52.957957+0000","last_undegraded":"2026-02-13T01:23:52.957957+0000","last_fullsized":"2026-02-13T01:23:52.957957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:49.567688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082616+0000","last_change":"2026-02-13T01:23:51.078417+0000","last_active":"2026-02-13T01:23:52.082616+0000","last_peered":"2026-02-13T01:23:52.082616+0000","last_clean":"2026-02-13T01:23:52.082616+0000","last_became_active":"2026-02-13T01:23:51.078110+0000","last_became_peered":"2026-02-13T01:23:51.078110+0000","last_unstale":"2026-02-13T01:23:52.082616+0000","last_undegraded":"2026-02-13T01:23:52.082616+0000","last_fullsized":"2026-02-13T01:23:52.082616+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:40:32.031019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312559+0000","last_change":"2026-02-13T01:23:50.313168+0000","last_active":"2026-02-13T01:23:52.312559+0000","last_peered":"2026-02-13T01:23:52.312559+0000","last_clean":"2026-02-13T01:23:52.312559+0000","last_became_active":"2026-02-13T01:23:50.312966+0000","last_became_peered":"2026-02-13T01:23:50.312966+0000","last_unstale":"2026-02-13T01:23:52.312559+0000","last_undegraded":"2026-02-13T01:23:52.312559+0000","last_fullsized":"2026-02-13T01:23:52.312559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:32.590208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311295+0000","last_change":"2026-02-13T01:23:51.076660+0000","last_active":"2026-02-13T01:23:52.311295+0000","last_peered":"2026-02-13T01:23:52.311295+0000","last_clean":"2026-02-13T01:23:52.311295+0000","last_became_active":"2026-02-13T01:23:51.076469+0000","last_became_peered":"2026-02-13T01:23:51.076469+0000","last_unstale":"2026-02-13T01:23:52.311295+0000","last_undegraded":"2026-02-13T01:23:52.311295+0000","last_fullsized":"2026-02-13T01:23:52.311295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:36:41.529123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103548+0000","last_change":"2026-02-13T01:23:50.314141+0000","last_active":"2026-02-13T01:23:56.103548+0000","last_peered":"2026-02-13T01:23:56.103548+0000","last_clean":"2026-02-13T01:23:56.103548+0000","last_became_active":"2026-02-13T01:23:50.313895+0000","last_became_peered":"2026-02-13T01:23:50.313895+0000","last_unstale":"2026-02-13T01:23:56.103548+0000","last_undegraded":"2026-02-13T01:23:56.103548+0000","last_fullsized":"2026-02-13T01:23:56.103548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:56:45.835321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083174+0000","last_change":"2026-02-13T01:23:51.087445+0000","last_active":"2026-02-13T01:23:52.083174+0000","last_peered":"2026-02-13T01:23:52.083174+0000","last_clean":"2026-02-13T01:23:52.083174+0000","last_became_active":"2026-02-13T01:23:51.087127+0000","last_became_peered":"2026-02-13T01:23:51.087127+0000","last_unstale":"2026-02-13T01:23:52.083174+0000","last_undegraded":"2026-02-13T01:23:52.083174+0000","last_fullsized":"2026-02-13T01:23:52.083174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:26:20.819554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.289274+0000","last_change":"2026-02-13T01:23:50.317601+0000","last_active":"2026-02-13T01:23:52.289274+0000","last_peered":"2026-02-13T01:23:52.289274+0000","last_clean":"2026-02-13T01:23:52.289274+0000","last_became_active":"2026-02-13T01:23:50.316929+0000","last_became_peered":"2026-02-13T01:23:50.316929+0000","last_unstale":"2026-02-13T01:23:52.289274+0000","last_undegraded":"2026-02-13T01:23:52.289274+0000","last_fullsized":"2026-02-13T01:23:52.289274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:53:18.429548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083050+0000","last_change":"2026-02-13T01:23:51.080679+0000","last_active":"2026-02-13T01:23:52.083050+0000","last_peered":"2026-02-13T01:23:52.083050+0000","last_clean":"2026-02-13T01:23:52.083050+0000","last_became_active":"2026-02-13T01:23:51.080556+0000","last_became_peered":"2026-02-13T01:23:51.080556+0000","last_unstale":"2026-02-13T01:23:52.083050+0000","last_undegraded":"2026-02-13T01:23:52.083050+0000","last_fullsized":"2026-02-13T01:23:52.083050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:21.252518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.107473+0000","last_change":"2026-02-13T01:23:50.319592+0000","last_active":"2026-02-13T01:23:56.107473+0000","last_peered":"2026-02-13T01:23:56.107473+0000","last_clean":"2026-02-13T01:23:56.107473+0000","last_became_active":"2026-02-13T01:23:50.319512+0000","last_became_peered":"2026-02-13T01:23:50.319512+0000","last_unstale":"2026-02-13T01:23:56.107473+0000","last_undegraded":"2026-02-13T01:23:56.107473+0000","last_fullsized":"2026-02-13T01:23:56.107473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:49.061751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12471,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":133,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":78035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":143437,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743431,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":390042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9130,"internal_metadata":27581526},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972360,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28372,"kb_used_data":1408,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733974828,"statfs":{"total":751619276800,"available":751590223872,"internally_reserved":0,"allocated":1441792,"data_stored":983040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24624,"internal_metadata":27566032},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103178,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":390278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23449,"internal_metadata":27567207},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332108,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":390198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31062,"internal_metadata":27559594},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561038,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28348,"kb_used_data":1384,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733974852,"statfs":{"total":751619276800,"available":751590248448,"internally_reserved":0,"allocated":1417216,"data_stored":982147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27424,"internal_metadata":27563232},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":389528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134,"internal_metadata":27565522},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920786,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28356,"kb_used_data":1392,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733974844,"statfs":{"total":751619276800,"available":751590240256,"internally_reserved":0,"allocated":1425408,"data_stored":981304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31302,"internal_metadata":27559354},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051603,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":390082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37333,"internal_metadata":27553323},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280533,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":389956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46345,"internal_metadata":27544311},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":54,"kb_used_meta":26889,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":392444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55586,"internal_metadata":27535070},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607576,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":415032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738394,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":390960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47331,"internal_metadata":27543325},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7583,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":10167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29616,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33866,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7908,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3458,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4500,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11384,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12333,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8608,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":9985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18036,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:24:02.831 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T01:24:02.832 INFO:tasks.cephadm:Setting up client nodes... 2026-02-13T01:24:02.832 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T01:24:03.016 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:03.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.209+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/4010727968 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc3f810f060 msgr2=0x7fc3f810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.209+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/4010727968 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc3f810f060 0x7fc3f810f430 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=4007232824010314260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3e40099a0 tx=0x7fc3e402ed70 comp rx=0 tx=0).stop 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.209+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/4010727968 shutdown_connections 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.209+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/4010727968 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc3f8115270 0x7fc3f8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.209+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/4010727968 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc3f810fa50 0x7fc3f8114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.209+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/4010727968 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc3f810f060 0x7fc3f810f430 unknown :-1 s=CLOSED pgs=206 gs=1 cs=0 l=1 c_cookie=4007232824010314260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.209+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/4010727968 >> 10.20.193.40:0/4010727968 conn(0x7fc3f80ec980 msgr2=0x7fc3f810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.209+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/4010727968 shutdown_connections 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.209+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/4010727968 wait complete. 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3fcdb56c0 1 Processor -- start 2026-02-13T01:24:03.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3fcdb56c0 1 -- start start 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3fcdb56c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc3f810f060 0x7fc3f811ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3fcdb56c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc3f8115270 0x7fc3f811d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3fcdb56c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc3f8122790 0x7fc3f8122c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3fcdb56c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f81231a0 con 0x7fc3f810f060 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3fcdb56c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f8123310 con 0x7fc3f8115270 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3fcdb56c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f81234d0 con 0x7fc3f8122790 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3f7fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc3f8122790 0x7fc3f8122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3f7fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc3f8122790 0x7fc3f8122c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:51680/0 (socket says 10.20.193.40:51680) 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3f7fff6c0 1 -- 10.20.193.40:0/3167215464 learned_addr learned my addr 10.20.193.40:0/3167215464 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3f6ffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc3f8115270 0x7fc3f811d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:03.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.210+0000 7fc3f77fe6c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc3f810f060 0x7fc3f811ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f6ffd6c0 1 -- 10.20.193.40:0/3167215464 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc3f8122790 msgr2=0x7fc3f8122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f6ffd6c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc3f8122790 0x7fc3f8122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f6ffd6c0 1 -- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc3f810f060 msgr2=0x7fc3f811ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f6ffd6c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc3f810f060 0x7fc3f811ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f6ffd6c0 1 -- 10.20.193.40:0/3167215464 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e4009590 con 0x7fc3f8115270 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f7fff6c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc3f8122790 0x7fc3f8122c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f6ffd6c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc3f8115270 0x7fc3f811d3d0 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3e8004750 tx=0x7fc3e800bae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f4ff96c0 1 -- 10.20.193.40:0/3167215464 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3e80044a0 con 0x7fc3f8115270 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f4ff96c0 1 -- 10.20.193.40:0/3167215464 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc3e8009030 con 0x7fc3f8115270 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3f4ff96c0 1 -- 10.20.193.40:0/3167215464 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3e800ce30 con 0x7fc3f8115270 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f8163980 con 0x7fc3f8115270 2026-02-13T01:24:03.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.211+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f8163e10 con 0x7fc3f8115270 2026-02-13T01:24:03.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.212+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f8110330 con 0x7fc3f8115270 2026-02-13T01:24:03.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.214+0000 7fc3f4ff96c0 1 -- 10.20.193.40:0/3167215464 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc3e800c370 con 0x7fc3f8115270 2026-02-13T01:24:03.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.215+0000 7fc3f4ff96c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc3cc0b5760 0x7fc3cc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:03.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.216+0000 7fc3f4ff96c0 1 -- 10.20.193.40:0/3167215464 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fc3e80e3a60 con 0x7fc3f8115270 2026-02-13T01:24:03.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.216+0000 7fc3f77fe6c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc3cc0b5760 0x7fc3cc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:03.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.216+0000 7fc3f4ff96c0 1 -- 10.20.193.40:0/3167215464 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc3e811c5e0 con 0x7fc3f8115270 2026-02-13T01:24:03.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.216+0000 7fc3f77fe6c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc3cc0b5760 0x7fc3cc0d5c10 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3e40098c0 tx=0x7fc3e40023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:03.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.354+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc3f810fa50 con 0x7fc3f8115270 2026-02-13T01:24:03.356 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:03 trial040 ceph-mon[23046]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:03.356 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:03 trial040 ceph-mon[23046]: pgmap v181: 97 pgs: 97 active+clean; 589 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 4.8 KiB/s wr, 15 op/s 2026-02-13T01:24:03.356 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:03 trial040 ceph-mon[23046]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:03.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.357+0000 7fc3f4ff96c0 1 -- 10.20.193.40:0/3167215464 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7fc3e80a63b0 con 0x7fc3f8115270 2026-02-13T01:24:03.358 INFO:teuthology.orchestra.run.trial040.stdout:[client.0] 2026-02-13T01:24:03.358 INFO:teuthology.orchestra.run.trial040.stdout: key = AQAzfY5pGEk1FRAAi7V1ivY0r1zzxeEwwkl5qQ== 2026-02-13T01:24:03.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc3cc0b5760 msgr2=0x7fc3cc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:03.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc3cc0b5760 0x7fc3cc0d5c10 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3e40098c0 tx=0x7fc3e40023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc3f8115270 msgr2=0x7fc3f811d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:03.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc3f8115270 0x7fc3f811d3d0 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3e8004750 tx=0x7fc3e800bae0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 shutdown_connections 2026-02-13T01:24:03.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc3cc0b5760 0x7fc3cc0d5c10 unknown :-1 s=CLOSED pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc3f8122790 0x7fc3f8122c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc3f8115270 0x7fc3f811d3d0 unknown :-1 s=CLOSED pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 --2- 10.20.193.40:0/3167215464 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc3f810f060 0x7fc3f811ce90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 >> 10.20.193.40:0/3167215464 conn(0x7fc3f80ec980 msgr2=0x7fc3f810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:03.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 shutdown_connections 2026-02-13T01:24:03.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.358+0000 7fc3fcdb56c0 1 -- 10.20.193.40:0/3167215464 wait complete. 2026-02-13T01:24:03.463 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-13T01:24:03.463 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-13T01:24:03.463 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T01:24:03.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:03 trial055 ceph-mon[27509]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:03.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:03 trial055 ceph-mon[27509]: pgmap v181: 97 pgs: 97 active+clean; 589 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 4.8 KiB/s wr, 15 op/s 2026-02-13T01:24:03.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:03 trial055 ceph-mon[27509]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:03.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:03 trial118 ceph-mon[27812]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:03.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:03 trial118 ceph-mon[27812]: pgmap v181: 97 pgs: 97 active+clean; 589 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 4.8 KiB/s wr, 15 op/s 2026-02-13T01:24:03.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:03 trial118 ceph-mon[27812]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:03.541 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-13T01:24:03.763 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:03.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 -- 10.20.193.40:0/1376158422 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc10fa50 msgr2=0x7fe8fc114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:03.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/1376158422 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc10fa50 0x7fe8fc114a90 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=414508651958056133 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8f00099a0 tx=0x7fe8f002ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:03.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 -- 10.20.193.40:0/1376158422 shutdown_connections 2026-02-13T01:24:03.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/1376158422 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe8fc115270 0x7fe8fc175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/1376158422 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc10fa50 0x7fe8fc114a90 unknown :-1 s=CLOSED pgs=207 gs=1 cs=0 l=1 c_cookie=414508651958056133 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/1376158422 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe8fc10f060 0x7fe8fc10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 -- 10.20.193.40:0/1376158422 >> 10.20.193.40:0/1376158422 conn(0x7fe8fc0ec980 msgr2=0x7fe8fc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:03.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 -- 10.20.193.40:0/1376158422 shutdown_connections 2026-02-13T01:24:03.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 -- 10.20.193.40:0/1376158422 wait complete. 2026-02-13T01:24:03.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.963+0000 7fe9033d76c0 1 Processor -- start 2026-02-13T01:24:03.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe9033d76c0 1 -- start start 2026-02-13T01:24:03.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe9033d76c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe8fc10f060 0x7fe8fc0f4860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:03.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe9033d76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc115270 0x7fe8fc175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe9033d76c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe8fc0f4e90 0x7fe8fc0fa160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe9033d76c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0f5580 con 0x7fe8fc115270 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe9033d76c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0fa6a0 con 0x7fe8fc10f060 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe9033d76c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0fa860 con 0x7fe8fc0f4e90 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe901bd46c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc115270 0x7fe8fc175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe901bd46c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc115270 0x7fe8fc175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33448/0 (socket says 10.20.193.40:33448) 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe901bd46c0 1 -- 10.20.193.40:0/2867981299 learned_addr learned my addr 10.20.193.40:0/2867981299 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe9023d56c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe8fc10f060 0x7fe8fc0f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe902bd66c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe8fc0f4e90 0x7fe8fc0fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe901bd46c0 1 -- 10.20.193.40:0/2867981299 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe8fc0f4e90 msgr2=0x7fe8fc0fa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:03.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe901bd46c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe8fc0f4e90 0x7fe8fc0fa160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe901bd46c0 1 -- 10.20.193.40:0/2867981299 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe8fc10f060 msgr2=0x7fe8fc0f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe901bd46c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe8fc10f060 0x7fe8fc0f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe901bd46c0 1 -- 10.20.193.40:0/2867981299 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f0009590 con 0x7fe8fc115270 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe9023d56c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe8fc10f060 0x7fe8fc0f4860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.964+0000 7fe901bd46c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc115270 0x7fe8fc175b10 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8f00072f0 tx=0x7fe8f002f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.965+0000 7fe8e37fe6c0 1 -- 10.20.193.40:0/2867981299 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8f00046b0 con 0x7fe8fc115270 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.965+0000 7fe8e37fe6c0 1 -- 10.20.193.40:0/2867981299 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe8f0002be0 con 0x7fe8fc115270 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.965+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8fc0faae0 con 0x7fe8fc115270 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.965+0000 7fe8e37fe6c0 1 -- 10.20.193.40:0/2867981299 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8f0007670 con 0x7fe8fc115270 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.965+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8fc0fafb0 con 0x7fe8fc115270 2026-02-13T01:24:03.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.965+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8fc110330 con 0x7fe8fc115270 2026-02-13T01:24:03.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.968+0000 7fe8e37fe6c0 1 -- 10.20.193.40:0/2867981299 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fe8f00312e0 con 0x7fe8fc115270 2026-02-13T01:24:03.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.969+0000 7fe8e37fe6c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe8d80b5760 0x7fe8d80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:03.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.970+0000 7fe8e37fe6c0 1 -- 10.20.193.40:0/2867981299 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fe8f0107dc0 con 0x7fe8fc115270 2026-02-13T01:24:03.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.970+0000 7fe9023d56c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe8d80b5760 0x7fe8d80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:03.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.970+0000 7fe8e37fe6c0 1 -- 10.20.193.40:0/2867981299 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe8f01082b0 con 0x7fe8fc115270 2026-02-13T01:24:03.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:03.970+0000 7fe9023d56c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe8d80b5760 0x7fe8d80d5c10 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8ec004750 tx=0x7fe8ec009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:04.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.070+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fe8fc10fa50 con 0x7fe8fc115270 2026-02-13T01:24:04.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.071+0000 7fe8e37fe6c0 1 -- 10.20.193.40:0/2867981299 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7fe8f00ca750 con 0x7fe8fc115270 2026-02-13T01:24:04.072 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:04.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe8d80b5760 msgr2=0x7fe8d80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:04.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe8d80b5760 0x7fe8d80d5c10 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8ec004750 tx=0x7fe8ec009260 comp rx=0 tx=0).stop 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc115270 msgr2=0x7fe8fc175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc115270 0x7fe8fc175b10 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8f00072f0 tx=0x7fe8f002f810 comp rx=0 tx=0).stop 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 shutdown_connections 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe8d80b5760 0x7fe8d80d5c10 unknown :-1 s=CLOSED pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe8fc0f4e90 0x7fe8fc0fa160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe8fc115270 0x7fe8fc175b10 unknown :-1 s=CLOSED pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 --2- 10.20.193.40:0/2867981299 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe8fc10f060 0x7fe8fc0f4860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 >> 10.20.193.40:0/2867981299 conn(0x7fe8fc0ec980 msgr2=0x7fe8fc10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 shutdown_connections 2026-02-13T01:24:04.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.072+0000 7fe9033d76c0 1 -- 10.20.193.40:0/2867981299 wait complete. 2026-02-13T01:24:04.147 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:04 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3167215464' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:24:04.147 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:04 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:24:04.148 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:04 trial040 ceph-mon[23046]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T01:24:04.148 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:04 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2867981299' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T01:24:04.175 INFO:teuthology.orchestra.run.trial040.stdout:[{"version":49,"timestamp":"2026-02-13T01:23:45.885249+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-13T01:24:04.175 INFO:tasks.ceph_manager:config epoch is 49 2026-02-13T01:24:04.175 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T01:24:04.175 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-13T01:24:04.176 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-13T01:24:04.359 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:04.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:04 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3167215464' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:24:04.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:04 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:24:04.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:04 trial055 ceph-mon[27509]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T01:24:04.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:04 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2867981299' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T01:24:04.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:04 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3167215464' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:24:04.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:04 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:24:04.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:04 trial118 ceph-mon[27812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T01:24:04.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:04 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2867981299' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T01:24:04.550 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 -- 10.20.193.40:0/1039875195 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18b810fa50 msgr2=0x7f18b8114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:04.550 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/1039875195 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18b810fa50 0x7f18b8114a90 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=15302849953102575233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a80099a0 tx=0x7f18a802ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:04.550 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 -- 10.20.193.40:0/1039875195 shutdown_connections 2026-02-13T01:24:04.551 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/1039875195 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18b8115270 0x7f18b8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.551 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/1039875195 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18b810fa50 0x7f18b8114a90 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=15302849953102575233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.551 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/1039875195 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18b810f060 0x7f18b810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.551 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 -- 10.20.193.40:0/1039875195 >> 10.20.193.40:0/1039875195 conn(0x7f18b80ec980 msgr2=0x7f18b810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:04.551 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 -- 10.20.193.40:0/1039875195 shutdown_connections 2026-02-13T01:24:04.551 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 -- 10.20.193.40:0/1039875195 wait complete. 2026-02-13T01:24:04.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.549+0000 7f18bd5946c0 1 Processor -- start 2026-02-13T01:24:04.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18bd5946c0 1 -- start start 2026-02-13T01:24:04.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18bd5946c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18b810f060 0x7f18b811ce70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:04.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18bd5946c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18b8115270 0x7f18b811d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:04.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18bd5946c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18b8122770 0x7f18b8122c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:04.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18bd5946c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8123180 con 0x7f18b8122770 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18bd5946c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81232f0 con 0x7f18b810f060 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18bd5946c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81234b0 con 0x7f18b8115270 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b7fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18b810f060 0x7f18b811ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b7fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18b810f060 0x7f18b811ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33398/0 (socket says 10.20.193.40:33398) 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b7fff6c0 1 -- 10.20.193.40:0/3207872507 learned_addr learned my addr 10.20.193.40:0/3207872507 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18bcd936c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18b8122770 0x7f18b8122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b77fe6c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18b8115270 0x7f18b811d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b7fff6c0 1 -- 10.20.193.40:0/3207872507 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18b8115270 msgr2=0x7f18b811d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b7fff6c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18b8115270 0x7f18b811d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b7fff6c0 1 -- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18b8122770 msgr2=0x7f18b8122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:04.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b7fff6c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18b8122770 0x7f18b8122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b7fff6c0 1 -- 10.20.193.40:0/3207872507 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a8009590 con 0x7f18b810f060 2026-02-13T01:24:04.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.550+0000 7f18b7fff6c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18b810f060 0x7f18b811ce70 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a4009490 tx=0x7f18a400bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:04.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.551+0000 7f18b57fa6c0 1 -- 10.20.193.40:0/3207872507 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18a4004a80 con 0x7f18b810f060 2026-02-13T01:24:04.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.551+0000 7f18b57fa6c0 1 -- 10.20.193.40:0/3207872507 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f18a4009030 con 0x7f18b810f060 2026-02-13T01:24:04.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.551+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b8163960 con 0x7f18b810f060 2026-02-13T01:24:04.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.551+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b8163df0 con 0x7f18b810f060 2026-02-13T01:24:04.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.551+0000 7f18b57fa6c0 1 -- 10.20.193.40:0/3207872507 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18a40071c0 con 0x7f18b810f060 2026-02-13T01:24:04.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.551+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b8110330 con 0x7f18b810f060 2026-02-13T01:24:04.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.553+0000 7f18b57fa6c0 1 -- 10.20.193.40:0/3207872507 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f18a4004e90 con 0x7f18b810f060 2026-02-13T01:24:04.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.555+0000 7f18b57fa6c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f188c0b56e0 0x7f188c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:04.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.555+0000 7f18b57fa6c0 1 -- 10.20.193.40:0/3207872507 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f18a40e3cc0 con 0x7f18b810f060 2026-02-13T01:24:04.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.555+0000 7f18b77fe6c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f188c0b56e0 0x7f188c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:04.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.555+0000 7f18b57fa6c0 1 -- 10.20.193.40:0/3207872507 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f18a40e4140 con 0x7f18b810f060 2026-02-13T01:24:04.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.556+0000 7f18b77fe6c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f188c0b56e0 0x7f188c0d5b90 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a80023e0 tx=0x7f18a80071c0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:04.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.684+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f18b811dfc0 con 0x7f18b810f060 2026-02-13T01:24:04.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.687+0000 7f18b57fa6c0 1 -- 10.20.193.40:0/3207872507 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v16) ==== 74+0+297595 (secure 0 0 0) 0x7f18a40a6610 con 0x7f18b810f060 2026-02-13T01:24:04.693 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:04.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f188c0b56e0 msgr2=0x7f188c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:04.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f188c0b56e0 0x7f188c0d5b90 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a80023e0 tx=0x7f18a80071c0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18b810f060 msgr2=0x7f18b811ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:04.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18b810f060 0x7f18b811ce70 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a4009490 tx=0x7f18a400bc50 comp rx=0 tx=0).stop 2026-02-13T01:24:04.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 shutdown_connections 2026-02-13T01:24:04.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f188c0b56e0 0x7f188c0d5b90 unknown :-1 s=CLOSED pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f18b8122770 0x7f18b8122c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f18b8115270 0x7f18b811d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 --2- 10.20.193.40:0/3207872507 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f18b810f060 0x7f18b811ce70 unknown :-1 s=CLOSED pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:04.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.690+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 >> 10.20.193.40:0/3207872507 conn(0x7f18b80ec980 msgr2=0x7f18b810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:04.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.691+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 shutdown_connections 2026-02-13T01:24:04.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:04.691+0000 7f18bd5946c0 1 -- 10.20.193.40:0/3207872507 wait complete. 2026-02-13T01:24:04.827 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":16,"flags":0,"active_gid":14190,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":1598245266},{"type":"v1","addr":"10.20.193.40:6801","nonce":1598245266}]},"active_addr":"10.20.193.40:6801/1598245266","active_change":"2026-02-13T01:21:35.857115+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":24259,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24272,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","iostat","nfs","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":4,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":2168911115}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":2875920335}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":2538870924}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":3534024305}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":2004638718}]}]} 2026-02-13T01:24:04.838 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-13T01:24:04.838 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-13T01:24:04.839 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:24:05.022 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:05.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.215+0000 7fba8a4026c0 1 -- 10.20.193.40:0/406955603 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba8410fa50 msgr2=0x7fba84114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.215+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/406955603 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba8410fa50 0x7fba84114a90 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=12852363626059741376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba780099a0 tx=0x7fba7802ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:05.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.215+0000 7fba8a4026c0 1 -- 10.20.193.40:0/406955603 shutdown_connections 2026-02-13T01:24:05.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.215+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/406955603 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fba84115270 0x7fba84175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.215+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/406955603 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba8410fa50 0x7fba84114a90 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=12852363626059741376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.215+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/406955603 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fba8410f060 0x7fba8410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.215+0000 7fba8a4026c0 1 -- 10.20.193.40:0/406955603 >> 10.20.193.40:0/406955603 conn(0x7fba840ec980 msgr2=0x7fba8410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:05.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.216+0000 7fba8a4026c0 1 -- 10.20.193.40:0/406955603 shutdown_connections 2026-02-13T01:24:05.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.216+0000 7fba8a4026c0 1 -- 10.20.193.40:0/406955603 wait complete. 2026-02-13T01:24:05.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.216+0000 7fba8a4026c0 1 Processor -- start 2026-02-13T01:24:05.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.216+0000 7fba8a4026c0 1 -- start start 2026-02-13T01:24:05.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba8a4026c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fba8410f060 0x7fba840f47f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:05.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba8a4026c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fba84115270 0x7fba84175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:05.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba8a4026c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba840f4e20 0x7fba840fa0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:05.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba8a4026c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fba840f5510 con 0x7fba840f4e20 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba8a4026c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fba840fa630 con 0x7fba8410f060 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba8a4026c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fba840fa7f0 con 0x7fba84115270 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba89c016c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba840f4e20 0x7fba840fa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba89c016c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba840f4e20 0x7fba840fa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33488/0 (socket says 10.20.193.40:33488) 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba89c016c0 1 -- 10.20.193.40:0/1553578012 learned_addr learned my addr 10.20.193.40:0/1553578012 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba88bff6c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fba84115270 0x7fba84175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba894006c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fba8410f060 0x7fba840f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba89c016c0 1 -- 10.20.193.40:0/1553578012 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fba84115270 msgr2=0x7fba84175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba89c016c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fba84115270 0x7fba84175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba89c016c0 1 -- 10.20.193.40:0/1553578012 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fba8410f060 msgr2=0x7fba840f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba89c016c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fba8410f060 0x7fba840f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba89c016c0 1 -- 10.20.193.40:0/1553578012 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba78009590 con 0x7fba840f4e20 2026-02-13T01:24:05.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba89c016c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba840f4e20 0x7fba840fa0f0 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba80006ea0 tx=0x7fba8000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:05.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba727fc6c0 1 -- 10.20.193.40:0/1553578012 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba80003c40 con 0x7fba840f4e20 2026-02-13T01:24:05.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba727fc6c0 1 -- 10.20.193.40:0/1553578012 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fba80003da0 con 0x7fba840f4e20 2026-02-13T01:24:05.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.217+0000 7fba727fc6c0 1 -- 10.20.193.40:0/1553578012 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba80008440 con 0x7fba840f4e20 2026-02-13T01:24:05.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.218+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba840faad0 con 0x7fba840f4e20 2026-02-13T01:24:05.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.218+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba840faf60 con 0x7fba840f4e20 2026-02-13T01:24:05.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.218+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba84110330 con 0x7fba840f4e20 2026-02-13T01:24:05.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.220+0000 7fba727fc6c0 1 -- 10.20.193.40:0/1553578012 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fba8000d690 con 0x7fba840f4e20 2026-02-13T01:24:05.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.222+0000 7fba727fc6c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fba600b5760 0x7fba600d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:05.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.222+0000 7fba727fc6c0 1 -- 10.20.193.40:0/1553578012 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fba800e4b60 con 0x7fba840f4e20 2026-02-13T01:24:05.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.222+0000 7fba894006c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fba600b5760 0x7fba600d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:05.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.222+0000 7fba727fc6c0 1 -- 10.20.193.40:0/1553578012 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fba8011d5e0 con 0x7fba840f4e20 2026-02-13T01:24:05.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.223+0000 7fba894006c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fba600b5760 0x7fba600d5c10 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba74004750 tx=0x7fba74009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:05.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.323+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba840faf60 con 0x7fba840f4e20 2026-02-13T01:24:05.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:05 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3207872507' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T01:24:05.325 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:05 trial040 ceph-mon[23046]: pgmap v182: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 8.7 KiB/s wr, 17 op/s 2026-02-13T01:24:05.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.323+0000 7fba727fc6c0 1 -- 10.20.193.40:0/1553578012 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22317 (secure 0 0 0) 0x7fba840faf60 con 0x7fba840f4e20 2026-02-13T01:24:05.326 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:05.326 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":74,"fsid":"304b456c-087a-11f1-98ea-d404e6e7d460","created":"2026-02-13T01:20:52.557389+0000","modified":"2026-02-13T01:23:52.076554+0000","last_up_change":"2026-02-13T01:23:30.097332+0000","last_in_change":"2026-02-13T01:23:21.835674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:22:12.069221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:23:48.399006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:23:49.929655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6fb8271-19fd-4149-91ec-ed412cd5dc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6803","nonce":3956883177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6805","nonce":3956883177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6809","nonce":3956883177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6807","nonce":3956883177}]},"public_addr":"10.20.193.40:6803/3956883177","cluster_addr":"10.20.193.40:6805/3956883177","heartbeat_back_addr":"10.20.193.40:6809/3956883177","heartbeat_front_addr":"10.20.193.40:6807/3956883177","state":["exists","up"]},{"osd":1,"uuid":"3d8d3277-423d-455b-af0d-67d15aaea487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6800","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6801","nonce":3110028162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6802","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6803","nonce":3110028162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6806","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6807","nonce":3110028162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6804","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6805","nonce":3110028162}]},"public_addr":"10.20.193.55:6801/3110028162","cluster_addr":"10.20.193.55:6803/3110028162","heartbeat_back_addr":"10.20.193.55:6807/3110028162","heartbeat_front_addr":"10.20.193.55:6805/3110028162","state":["exists","up"]},{"osd":2,"uuid":"9d84270b-3934-48db-99a7-d6b8845c344d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6800","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6801","nonce":2584237293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6802","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6803","nonce":2584237293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6806","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6807","nonce":2584237293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6804","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6805","nonce":2584237293}]},"public_addr":"10.20.193.118:6801/2584237293","cluster_addr":"10.20.193.118:6803/2584237293","heartbeat_back_addr":"10.20.193.118:6807/2584237293","heartbeat_front_addr":"10.20.193.118:6805/2584237293","state":["exists","up"]},{"osd":3,"uuid":"d7a9da01-a235-4069-9e09-562abc3c2ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6811","nonce":485777007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6813","nonce":485777007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6817","nonce":485777007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6815","nonce":485777007}]},"public_addr":"10.20.193.40:6811/485777007","cluster_addr":"10.20.193.40:6813/485777007","heartbeat_back_addr":"10.20.193.40:6817/485777007","heartbeat_front_addr":"10.20.193.40:6815/485777007","state":["exists","up"]},{"osd":4,"uuid":"a3a5b0ea-f758-46ce-bd6d-afaa74db16bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6808","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6809","nonce":3166522039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6810","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6811","nonce":3166522039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6814","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6815","nonce":3166522039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6812","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6813","nonce":3166522039}]},"public_addr":"10.20.193.55:6809/3166522039","cluster_addr":"10.20.193.55:6811/3166522039","heartbeat_back_addr":"10.20.193.55:6815/3166522039","heartbeat_front_addr":"10.20.193.55:6813/3166522039","state":["exists","up"]},{"osd":5,"uuid":"785971ea-187d-4818-a068-2f11a062f7f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6808","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6809","nonce":674220568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6810","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6811","nonce":674220568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6814","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6815","nonce":674220568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6812","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6813","nonce":674220568}]},"public_addr":"10.20.193.118:6809/674220568","cluster_addr":"10.20.193.118:6811/674220568","heartbeat_back_addr":"10.20.193.118:6815/674220568","heartbeat_front_addr":"10.20.193.118:6813/674220568","state":["exists","up"]},{"osd":6,"uuid":"d852201c-70dd-4be3-af89-2a49bdf1e9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6819","nonce":3706078337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6821","nonce":3706078337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6824","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6825","nonce":3706078337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6823","nonce":3706078337}]},"public_addr":"10.20.193.40:6819/3706078337","cluster_addr":"10.20.193.40:6821/3706078337","heartbeat_back_addr":"10.20.193.40:6825/3706078337","heartbeat_front_addr":"10.20.193.40:6823/3706078337","state":["exists","up"]},{"osd":7,"uuid":"55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6816","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6817","nonce":1340798625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6818","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6819","nonce":1340798625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6822","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6823","nonce":1340798625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6820","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6821","nonce":1340798625}]},"public_addr":"10.20.193.55:6817/1340798625","cluster_addr":"10.20.193.55:6819/1340798625","heartbeat_back_addr":"10.20.193.55:6823/1340798625","heartbeat_front_addr":"10.20.193.55:6821/1340798625","state":["exists","up"]},{"osd":8,"uuid":"9a727c13-2b82-4465-9c5a-af294ba75403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6816","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6817","nonce":2741939670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6818","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6819","nonce":2741939670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6822","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6823","nonce":2741939670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6820","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6821","nonce":2741939670}]},"public_addr":"10.20.193.118:6817/2741939670","cluster_addr":"10.20.193.118:6819/2741939670","heartbeat_back_addr":"10.20.193.118:6823/2741939670","heartbeat_front_addr":"10.20.193.118:6821/2741939670","state":["exists","up"]},{"osd":9,"uuid":"2e674b08-c75c-41c1-a91b-09987dfb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6827","nonce":1636530405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6828","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6829","nonce":1636530405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6832","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6833","nonce":1636530405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6831","nonce":1636530405}]},"public_addr":"10.20.193.40:6827/1636530405","cluster_addr":"10.20.193.40:6829/1636530405","heartbeat_back_addr":"10.20.193.40:6833/1636530405","heartbeat_front_addr":"10.20.193.40:6831/1636530405","state":["exists","up"]},{"osd":10,"uuid":"c0253c41-b910-4637-aae8-5c00bc814dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6824","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6825","nonce":461194356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6826","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6827","nonce":461194356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6830","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6831","nonce":461194356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6828","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6829","nonce":461194356}]},"public_addr":"10.20.193.55:6825/461194356","cluster_addr":"10.20.193.55:6827/461194356","heartbeat_back_addr":"10.20.193.55:6831/461194356","heartbeat_front_addr":"10.20.193.55:6829/461194356","state":["exists","up"]},{"osd":11,"uuid":"de7616d6-df2d-4ade-8676-6c4e95da253c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6824","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6825","nonce":1832833901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6826","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6827","nonce":1832833901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6830","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6831","nonce":1832833901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6828","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6829","nonce":1832833901}]},"public_addr":"10.20.193.118:6825/1832833901","cluster_addr":"10.20.193.118:6827/1832833901","heartbeat_back_addr":"10.20.193.118:6831/1832833901","heartbeat_front_addr":"10.20.193.118:6829/1832833901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:21:55.803128+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:03.064285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:10.128421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:20.969922+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:28.580756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:35.696627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:46.838480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:54.619455+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:02.014372+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:12.955709+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:20.865741+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:28.300625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.40:6801/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:6800/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/743801918":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1188631814":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1549127191":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/4084024233":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/2202236316":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/3369709934":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6801/2001072148":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6800/2001072148":"2026-02-14T01:21:00.614882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:24:05.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.325+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fba600b5760 msgr2=0x7fba600d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.325+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fba600b5760 0x7fba600d5c10 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba74004750 tx=0x7fba74009260 comp rx=0 tx=0).stop 2026-02-13T01:24:05.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.325+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba840f4e20 msgr2=0x7fba840fa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.325+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba840f4e20 0x7fba840fa0f0 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba80006ea0 tx=0x7fba8000ce50 comp rx=0 tx=0).stop 2026-02-13T01:24:05.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.326+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 shutdown_connections 2026-02-13T01:24:05.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.326+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fba600b5760 0x7fba600d5c10 unknown :-1 s=CLOSED pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.326+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fba840f4e20 0x7fba840fa0f0 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.326+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fba84115270 0x7fba84175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.326+0000 7fba8a4026c0 1 --2- 10.20.193.40:0/1553578012 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fba8410f060 0x7fba840f47f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.326+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 >> 10.20.193.40:0/1553578012 conn(0x7fba840ec980 msgr2=0x7fba8410d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:05.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.326+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 shutdown_connections 2026-02-13T01:24:05.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.326+0000 7fba8a4026c0 1 -- 10.20.193.40:0/1553578012 wait complete. 2026-02-13T01:24:05.432 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-13T01:24:05.432 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:24:05.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:05 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3207872507' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T01:24:05.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:05 trial055 ceph-mon[27509]: pgmap v182: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 8.7 KiB/s wr, 17 op/s 2026-02-13T01:24:05.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:05 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3207872507' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T01:24:05.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:05 trial118 ceph-mon[27812]: pgmap v182: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 8.7 KiB/s wr, 17 op/s 2026-02-13T01:24:05.616 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:05.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.817+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/2687034318 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 msgr2=0x7fa5f4175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.817+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/2687034318 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 0x7fa5f4175c10 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=3399052996894331353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f000aa70 tx=0x7fa5f002fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.817+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/2687034318 shutdown_connections 2026-02-13T01:24:05.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.817+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/2687034318 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 0x7fa5f4175c10 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=3399052996894331353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.817+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/2687034318 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa5f410fa50 0x7fa5f4114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.817+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/2687034318 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa5f410f060 0x7fa5f410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.817+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/2687034318 >> 10.20.193.40:0/2687034318 conn(0x7fa5f40ec980 msgr2=0x7fa5f410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:05.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.817+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/2687034318 shutdown_connections 2026-02-13T01:24:05.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.817+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/2687034318 wait complete. 2026-02-13T01:24:05.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.818+0000 7fa5fb2ab6c0 1 Processor -- start 2026-02-13T01:24:05.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.818+0000 7fa5fb2ab6c0 1 -- start start 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.818+0000 7fa5fb2ab6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa5f410f060 0x7fa5f411cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.818+0000 7fa5fb2ab6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 0x7fa5f411d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5fb2ab6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa5f4122680 0x7fa5f4122b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5f9aa86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 0x7fa5f411d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5fb2ab6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4123090 con 0x7fa5f4115270 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5fb2ab6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4123200 con 0x7fa5f410f060 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5fb2ab6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41233c0 con 0x7fa5f4122680 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5f9aa86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 0x7fa5f411d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33504/0 (socket says 10.20.193.40:33504) 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5f9aa86c0 1 -- 10.20.193.40:0/97599170 learned_addr learned my addr 10.20.193.40:0/97599170 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5fa2a96c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa5f410f060 0x7fa5f411cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:05.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5f9aa86c0 1 -- 10.20.193.40:0/97599170 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa5f4122680 msgr2=0x7fa5f4122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5f9aa86c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa5f4122680 0x7fa5f4122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5f9aa86c0 1 -- 10.20.193.40:0/97599170 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa5f410f060 msgr2=0x7fa5f411cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5f9aa86c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa5f410f060 0x7fa5f411cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5f9aa86c0 1 -- 10.20.193.40:0/97599170 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f000a660 con 0x7fa5f4115270 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5f9aa86c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 0x7fa5f411d2c0 secure :-1 s=READY pgs=213 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5e8005dc0 tx=0x7fa5e800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5db7fe6c0 1 -- 10.20.193.40:0/97599170 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5e8004250 con 0x7fa5f4115270 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5db7fe6c0 1 -- 10.20.193.40:0/97599170 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa5e8009070 con 0x7fa5f4115270 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5db7fe6c0 1 -- 10.20.193.40:0/97599170 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5e80071c0 con 0x7fa5f4115270 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f4163870 con 0x7fa5f4115270 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.819+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f4163d50 con 0x7fa5f4115270 2026-02-13T01:24:05.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.820+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f4110330 con 0x7fa5f4115270 2026-02-13T01:24:05.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.822+0000 7fa5db7fe6c0 1 -- 10.20.193.40:0/97599170 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa5e80043b0 con 0x7fa5f4115270 2026-02-13T01:24:05.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.824+0000 7fa5db7fe6c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa5d00b5760 0x7fa5d00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:05.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.824+0000 7fa5db7fe6c0 1 -- 10.20.193.40:0/97599170 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fa5e80e3c10 con 0x7fa5f4115270 2026-02-13T01:24:05.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.824+0000 7fa5db7fe6c0 1 -- 10.20.193.40:0/97599170 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa5e80e4100 con 0x7fa5f4115270 2026-02-13T01:24:05.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.824+0000 7fa5fa2a96c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa5d00b5760 0x7fa5d00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:05.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.825+0000 7fa5fa2a96c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa5d00b5760 0x7fa5d00d5c10 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5e4005980 tx=0x7fa5e4005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:05.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.926+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5f411df00 con 0x7fa5f4115270 2026-02-13T01:24:05.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.926+0000 7fa5db7fe6c0 1 -- 10.20.193.40:0/97599170 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22317 (secure 0 0 0) 0x7fa5e80a65a0 con 0x7fa5f4115270 2026-02-13T01:24:05.928 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:05.928 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":74,"fsid":"304b456c-087a-11f1-98ea-d404e6e7d460","created":"2026-02-13T01:20:52.557389+0000","modified":"2026-02-13T01:23:52.076554+0000","last_up_change":"2026-02-13T01:23:30.097332+0000","last_in_change":"2026-02-13T01:23:21.835674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:22:12.069221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:23:48.399006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:23:49.929655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6fb8271-19fd-4149-91ec-ed412cd5dc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6803","nonce":3956883177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6805","nonce":3956883177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6809","nonce":3956883177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":3956883177},{"type":"v1","addr":"10.20.193.40:6807","nonce":3956883177}]},"public_addr":"10.20.193.40:6803/3956883177","cluster_addr":"10.20.193.40:6805/3956883177","heartbeat_back_addr":"10.20.193.40:6809/3956883177","heartbeat_front_addr":"10.20.193.40:6807/3956883177","state":["exists","up"]},{"osd":1,"uuid":"3d8d3277-423d-455b-af0d-67d15aaea487","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6800","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6801","nonce":3110028162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6802","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6803","nonce":3110028162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6806","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6807","nonce":3110028162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6804","nonce":3110028162},{"type":"v1","addr":"10.20.193.55:6805","nonce":3110028162}]},"public_addr":"10.20.193.55:6801/3110028162","cluster_addr":"10.20.193.55:6803/3110028162","heartbeat_back_addr":"10.20.193.55:6807/3110028162","heartbeat_front_addr":"10.20.193.55:6805/3110028162","state":["exists","up"]},{"osd":2,"uuid":"9d84270b-3934-48db-99a7-d6b8845c344d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6800","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6801","nonce":2584237293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6802","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6803","nonce":2584237293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6806","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6807","nonce":2584237293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6804","nonce":2584237293},{"type":"v1","addr":"10.20.193.118:6805","nonce":2584237293}]},"public_addr":"10.20.193.118:6801/2584237293","cluster_addr":"10.20.193.118:6803/2584237293","heartbeat_back_addr":"10.20.193.118:6807/2584237293","heartbeat_front_addr":"10.20.193.118:6805/2584237293","state":["exists","up"]},{"osd":3,"uuid":"d7a9da01-a235-4069-9e09-562abc3c2ba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6811","nonce":485777007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6813","nonce":485777007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6817","nonce":485777007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":485777007},{"type":"v1","addr":"10.20.193.40:6815","nonce":485777007}]},"public_addr":"10.20.193.40:6811/485777007","cluster_addr":"10.20.193.40:6813/485777007","heartbeat_back_addr":"10.20.193.40:6817/485777007","heartbeat_front_addr":"10.20.193.40:6815/485777007","state":["exists","up"]},{"osd":4,"uuid":"a3a5b0ea-f758-46ce-bd6d-afaa74db16bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6808","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6809","nonce":3166522039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6810","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6811","nonce":3166522039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6814","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6815","nonce":3166522039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6812","nonce":3166522039},{"type":"v1","addr":"10.20.193.55:6813","nonce":3166522039}]},"public_addr":"10.20.193.55:6809/3166522039","cluster_addr":"10.20.193.55:6811/3166522039","heartbeat_back_addr":"10.20.193.55:6815/3166522039","heartbeat_front_addr":"10.20.193.55:6813/3166522039","state":["exists","up"]},{"osd":5,"uuid":"785971ea-187d-4818-a068-2f11a062f7f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6808","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6809","nonce":674220568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6810","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6811","nonce":674220568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6814","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6815","nonce":674220568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6812","nonce":674220568},{"type":"v1","addr":"10.20.193.118:6813","nonce":674220568}]},"public_addr":"10.20.193.118:6809/674220568","cluster_addr":"10.20.193.118:6811/674220568","heartbeat_back_addr":"10.20.193.118:6815/674220568","heartbeat_front_addr":"10.20.193.118:6813/674220568","state":["exists","up"]},{"osd":6,"uuid":"d852201c-70dd-4be3-af89-2a49bdf1e9eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6819","nonce":3706078337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6821","nonce":3706078337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6824","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6825","nonce":3706078337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3706078337},{"type":"v1","addr":"10.20.193.40:6823","nonce":3706078337}]},"public_addr":"10.20.193.40:6819/3706078337","cluster_addr":"10.20.193.40:6821/3706078337","heartbeat_back_addr":"10.20.193.40:6825/3706078337","heartbeat_front_addr":"10.20.193.40:6823/3706078337","state":["exists","up"]},{"osd":7,"uuid":"55f0c8b9-4d3f-4bb6-84c0-73ad0bb28edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6816","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6817","nonce":1340798625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6818","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6819","nonce":1340798625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6822","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6823","nonce":1340798625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6820","nonce":1340798625},{"type":"v1","addr":"10.20.193.55:6821","nonce":1340798625}]},"public_addr":"10.20.193.55:6817/1340798625","cluster_addr":"10.20.193.55:6819/1340798625","heartbeat_back_addr":"10.20.193.55:6823/1340798625","heartbeat_front_addr":"10.20.193.55:6821/1340798625","state":["exists","up"]},{"osd":8,"uuid":"9a727c13-2b82-4465-9c5a-af294ba75403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6816","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6817","nonce":2741939670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6818","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6819","nonce":2741939670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6822","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6823","nonce":2741939670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6820","nonce":2741939670},{"type":"v1","addr":"10.20.193.118:6821","nonce":2741939670}]},"public_addr":"10.20.193.118:6817/2741939670","cluster_addr":"10.20.193.118:6819/2741939670","heartbeat_back_addr":"10.20.193.118:6823/2741939670","heartbeat_front_addr":"10.20.193.118:6821/2741939670","state":["exists","up"]},{"osd":9,"uuid":"2e674b08-c75c-41c1-a91b-09987dfb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6827","nonce":1636530405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6828","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6829","nonce":1636530405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6832","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6833","nonce":1636530405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1636530405},{"type":"v1","addr":"10.20.193.40:6831","nonce":1636530405}]},"public_addr":"10.20.193.40:6827/1636530405","cluster_addr":"10.20.193.40:6829/1636530405","heartbeat_back_addr":"10.20.193.40:6833/1636530405","heartbeat_front_addr":"10.20.193.40:6831/1636530405","state":["exists","up"]},{"osd":10,"uuid":"c0253c41-b910-4637-aae8-5c00bc814dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6824","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6825","nonce":461194356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6826","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6827","nonce":461194356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6830","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6831","nonce":461194356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.55:6828","nonce":461194356},{"type":"v1","addr":"10.20.193.55:6829","nonce":461194356}]},"public_addr":"10.20.193.55:6825/461194356","cluster_addr":"10.20.193.55:6827/461194356","heartbeat_back_addr":"10.20.193.55:6831/461194356","heartbeat_front_addr":"10.20.193.55:6829/461194356","state":["exists","up"]},{"osd":11,"uuid":"de7616d6-df2d-4ade-8676-6c4e95da253c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6824","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6825","nonce":1832833901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6826","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6827","nonce":1832833901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6830","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6831","nonce":1832833901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.118:6828","nonce":1832833901},{"type":"v1","addr":"10.20.193.118:6829","nonce":1832833901}]},"public_addr":"10.20.193.118:6825/1832833901","cluster_addr":"10.20.193.118:6827/1832833901","heartbeat_back_addr":"10.20.193.118:6831/1832833901","heartbeat_front_addr":"10.20.193.118:6829/1832833901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:21:55.803128+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:03.064285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:10.128421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:20.969922+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:28.580756+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:35.696627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:46.838480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:22:54.619455+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:02.014372+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:12.955709+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:20.865741+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:28.300625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.40:6801/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:6800/1580729377":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/743801918":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1188631814":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/1549127191":"2026-02-14T01:21:35.857049+0000","10.20.193.40:0/4084024233":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/2202236316":"2026-02-14T01:21:00.614882+0000","10.20.193.40:0/3369709934":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6801/2001072148":"2026-02-14T01:21:00.614882+0000","10.20.193.40:6800/2001072148":"2026-02-14T01:21:00.614882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:24:05.929 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa5d00b5760 msgr2=0x7fa5d00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa5d00b5760 0x7fa5d00d5c10 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5e4005980 tx=0x7fa5e4005910 comp rx=0 tx=0).stop 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 msgr2=0x7fa5f411d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 0x7fa5f411d2c0 secure :-1 s=READY pgs=213 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5e8005dc0 tx=0x7fa5e800bbb0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 shutdown_connections 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa5d00b5760 0x7fa5d00d5c10 unknown :-1 s=CLOSED pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa5f4122680 0x7fa5f4122b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa5f4115270 0x7fa5f411d2c0 unknown :-1 s=CLOSED pgs=213 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 --2- 10.20.193.40:0/97599170 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa5f410f060 0x7fa5f411cd80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 >> 10.20.193.40:0/97599170 conn(0x7fa5f40ec980 msgr2=0x7fa5f410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:05.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 shutdown_connections 2026-02-13T01:24:05.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:05.928+0000 7fa5fb2ab6c0 1 -- 10.20.193.40:0/97599170 wait complete. 2026-02-13T01:24:06.034 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-13T01:24:06.034 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-13T01:24:06.035 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-13T01:24:06.035 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-13T01:24:06.036 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-13T01:24:06.036 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-13T01:24:06.036 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-13T01:24:06.037 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-13T01:24:06.037 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-13T01:24:06.038 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-13T01:24:06.039 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-13T01:24:06.039 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-13T01:24:06.253 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:06 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1553578012' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:06.253 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:06 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/97599170' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:06.298 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.311 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.328 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.341 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.373 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.377 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.419 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.426 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.435 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.437 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.451 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.456 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:06.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:06 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1553578012' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:06.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:06 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/97599170' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:06.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:06 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1553578012' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:06.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:06 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/97599170' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:06.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.594+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/2478822703 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3fdc1149f0 msgr2=0x7f3fdc1193d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.594+0000 7f3fe45bc6c0 1 --2- 10.20.193.40:0/2478822703 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3fdc1149f0 0x7f3fdc1193d0 secure :-1 s=READY pgs=214 gs=3 cs=0 l=1 c_cookie=5008288244667185279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fd0009bd0 tx=0x7f3fd002efb0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.595+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/2478822703 shutdown_connections 2026-02-13T01:24:06.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.596+0000 7f3fe45bc6c0 1 --2- 10.20.193.40:0/2478822703 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3fdc119bb0 0x7f3fdc17a550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.596+0000 7f3fe45bc6c0 1 --2- 10.20.193.40:0/2478822703 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3fdc1149f0 0x7f3fdc1193d0 unknown :-1 s=CLOSED pgs=214 gs=3 cs=0 l=1 c_cookie=5008288244667185279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.596+0000 7f3fe45bc6c0 1 --2- 10.20.193.40:0/2478822703 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3fdc114000 0x7f3fdc1143d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.596+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/2478822703 >> 10.20.193.40:0/2478822703 conn(0x7f3fdc0584d0 msgr2=0x7f3fdc0588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.596+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/2478822703 shutdown_connections 2026-02-13T01:24:06.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.597+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/2478822703 wait complete. 2026-02-13T01:24:06.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.597+0000 7f3fe45bc6c0 1 Processor -- start 2026-02-13T01:24:06.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.598+0000 7f3fe45bc6c0 1 -- start start 2026-02-13T01:24:06.600 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.599+0000 7f3fe45bc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3fdc114000 0x7f3fdc18ab80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.600 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.599+0000 7f3fe45bc6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3fdc119bb0 0x7f3fdc18b0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.599+0000 7f3fe45bc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3fdc185f80 0x7f3fdc186420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.600+0000 7f3fe1b2c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3fdc119bb0 0x7f3fdc18b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.600+0000 7f3fe1b2c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3fdc119bb0 0x7f3fdc18b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:51764/0 (socket says 10.20.193.40:51764) 2026-02-13T01:24:06.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.600+0000 7f3fe332f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3fdc114000 0x7f3fdc18ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.600+0000 7f3fe232d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3fdc185f80 0x7f3fdc186420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.600+0000 7f3fe1b2c6c0 1 -- 10.20.193.40:0/1307012103 learned_addr learned my addr 10.20.193.40:0/1307012103 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.601+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/1307012103 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc186bb0 con 0x7f3fdc185f80 2026-02-13T01:24:06.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.601+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/1307012103 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc15b450 con 0x7f3fdc114000 2026-02-13T01:24:06.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.601+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/1307012103 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc15b610 con 0x7f3fdc119bb0 2026-02-13T01:24:06.604 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.602+0000 7f3fe232d6c0 1 -- 10.20.193.40:0/1307012103 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3fdc119bb0 msgr2=0x7f3fdc18b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.604 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.602+0000 7f3fe232d6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3fdc119bb0 0x7f3fdc18b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.604 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.602+0000 7f3fe232d6c0 1 -- 10.20.193.40:0/1307012103 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3fdc114000 msgr2=0x7f3fdc18ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.602+0000 7f3fe232d6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3fdc114000 0x7f3fdc18ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.602+0000 7f3fe232d6c0 1 -- 10.20.193.40:0/1307012103 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd0009590 con 0x7f3fdc185f80 2026-02-13T01:24:06.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.602+0000 7f3fe232d6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3fdc185f80 0x7f3fdc186420 secure :-1 s=READY pgs=215 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fd800c490 tx=0x7f3fd800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.603+0000 7f3fcb7fe6c0 1 -- 10.20.193.40:0/1307012103 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3fd80054a0 con 0x7f3fdc185f80 2026-02-13T01:24:06.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.603+0000 7f3fcb7fe6c0 1 -- 10.20.193.40:0/1307012103 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3fd8005600 con 0x7f3fdc185f80 2026-02-13T01:24:06.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.603+0000 7f3fcb7fe6c0 1 -- 10.20.193.40:0/1307012103 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3fd800dda0 con 0x7f3fdc185f80 2026-02-13T01:24:06.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.603+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/1307012103 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc15b8f0 con 0x7f3fdc185f80 2026-02-13T01:24:06.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.604+0000 7f3fe45bc6c0 1 -- 10.20.193.40:0/1307012103 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc15bd80 con 0x7f3fdc185f80 2026-02-13T01:24:06.608 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.607+0000 7f3fc97fa6c0 1 -- 10.20.193.40:0/1307012103 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fdc052a50 con 0x7f3fdc185f80 2026-02-13T01:24:06.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.619+0000 7f3fcb7fe6c0 1 -- 10.20.193.40:0/1307012103 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f3fd8003810 con 0x7f3fdc185f80 2026-02-13T01:24:06.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.620+0000 7f3fcb7fe6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3fbc0b5830 0x7f3fbc0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.624 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.622+0000 7f3fcb7fe6c0 1 -- 10.20.193.40:0/1307012103 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f3fd80ab580 con 0x7f3fdc185f80 2026-02-13T01:24:06.624 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.622+0000 7f3fcb7fe6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] conn(0x7f3fbc0dcfa0 0x7f3fbc0fd3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.624 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.622+0000 7f3fe332f6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3fbc0b5830 0x7f3fbc0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.625 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.623+0000 7f3fe332f6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3fbc0b5830 0x7f3fbc0d5ce0 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fcc005980 tx=0x7f3fcc0094b0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.625 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.623+0000 7f3fcb7fe6c0 1 -- 10.20.193.40:0/1307012103 --> [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fbc0fda60 con 0x7f3fbc0dcfa0 2026-02-13T01:24:06.625 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.624+0000 7f3fcb7fe6c0 1 -- 10.20.193.40:0/1307012103 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f3fd8007e80 con 0x7f3fdc185f80 2026-02-13T01:24:06.625 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.624+0000 7f3fe1b2c6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] conn(0x7f3fbc0dcfa0 0x7f3fbc0fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.628 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.627+0000 7f3fe1b2c6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] conn(0x7f3fbc0dcfa0 0x7f3fbc0fd3b0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.628+0000 7f3fcb7fe6c0 1 -- 10.20.193.40:0/1307012103 <== osd.5 v2:10.20.193.118:6808/674220568 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f3fbc0fda60 con 0x7f3fbc0dcfa0 2026-02-13T01:24:06.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.644+0000 7f3fc97fa6c0 1 -- 10.20.193.40:0/1307012103 --> [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3fdc114cf0 con 0x7f3fbc0dcfa0 2026-02-13T01:24:06.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.644+0000 7f3fcb7fe6c0 1 -- 10.20.193.40:0/1307012103 <== osd.5 v2:10.20.193.118:6808/674220568 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3fdc114cf0 con 0x7f3fbc0dcfa0 2026-02-13T01:24:06.646 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.644+0000 7f3fc97fa6c0 1 -- 10.20.193.40:0/1307012103 >> [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] conn(0x7f3fbc0dcfa0 msgr2=0x7f3fbc0fd3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.646 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.644+0000 7f3fc97fa6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.118:6808/674220568,v1:10.20.193.118:6809/674220568] conn(0x7f3fbc0dcfa0 0x7f3fbc0fd3b0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.645+0000 7f3fc97fa6c0 1 -- 10.20.193.40:0/1307012103 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3fbc0b5830 msgr2=0x7f3fbc0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.645+0000 7f3fc97fa6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3fbc0b5830 0x7f3fbc0d5ce0 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fcc005980 tx=0x7f3fcc0094b0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.645+0000 7f3fc97fa6c0 1 -- 10.20.193.40:0/1307012103 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3fdc185f80 msgr2=0x7f3fdc186420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.645+0000 7f3fc97fa6c0 1 --2- 10.20.193.40:0/1307012103 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3fdc185f80 0x7f3fdc186420 secure :-1 s=READY pgs=215 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fd800c490 tx=0x7f3fd800c960 comp rx=0 tx=0).stop 2026-02-13T01:24:06.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.645+0000 7f3fe232d6c0 1 -- 10.20.193.40:0/1307012103 reap_dead start 2026-02-13T01:24:06.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.646+0000 7f3fc97fa6c0 1 -- 10.20.193.40:0/1307012103 shutdown_connections 2026-02-13T01:24:06.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.646+0000 7f3fc97fa6c0 1 -- 10.20.193.40:0/1307012103 >> 10.20.193.40:0/1307012103 conn(0x7f3fdc0584d0 msgr2=0x7f3fdc117a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.647+0000 7f3fc97fa6c0 1 -- 10.20.193.40:0/1307012103 shutdown_connections 2026-02-13T01:24:06.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.647+0000 7f3fc97fa6c0 1 -- 10.20.193.40:0/1307012103 wait complete. 2026-02-13T01:24:06.658 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.656+0000 7f54204696c0 1 -- 10.20.193.40:0/2390608357 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54100bd010 msgr2=0x7f541011d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.658 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.656+0000 7f54204696c0 1 --2- 10.20.193.40:0/2390608357 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54100bd010 0x7f541011d9b0 secure :-1 s=READY pgs=216 gs=2 cs=0 l=1 c_cookie=15971538042898544615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f541400ac10 tx=0x7f541402ff70 comp rx=0 tx=0).stop 2026-02-13T01:24:06.659 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.657+0000 7f54204696c0 1 -- 10.20.193.40:0/2390608357 shutdown_connections 2026-02-13T01:24:06.659 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.657+0000 7f54204696c0 1 --2- 10.20.193.40:0/2390608357 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54100bd010 0x7f541011d9b0 unknown :-1 s=CLOSED pgs=216 gs=2 cs=0 l=1 c_cookie=15971538042898544615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.659 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.657+0000 7f54204696c0 1 --2- 10.20.193.40:0/2390608357 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f54100b77f0 0x7f54100bc830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.659 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.657+0000 7f54204696c0 1 --2- 10.20.193.40:0/2390608357 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f54100b6e00 0x7f54100b71d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.660 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.658+0000 7f54204696c0 1 -- 10.20.193.40:0/2390608357 >> 10.20.193.40:0/2390608357 conn(0x7f5410094680 msgr2=0x7f54100b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.660 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.658+0000 7f54204696c0 1 -- 10.20.193.40:0/2390608357 shutdown_connections 2026-02-13T01:24:06.660 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.658+0000 7f54204696c0 1 -- 10.20.193.40:0/2390608357 wait complete. 2026-02-13T01:24:06.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.662+0000 7f37db5da6c0 1 -- 10.20.193.40:0/884111955 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f37d00ca7a0 msgr2=0x7f37d012ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.662+0000 7f37db5da6c0 1 --2- 10.20.193.40:0/884111955 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f37d00ca7a0 0x7f37d012ad80 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=5630810355424445180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c800aa40 tx=0x7f37c802fe30 comp rx=0 tx=0).stop 2026-02-13T01:24:06.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.662+0000 7f54204696c0 1 Processor -- start 2026-02-13T01:24:06.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.663+0000 7f54204696c0 1 -- start start 2026-02-13T01:24:06.671 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.669+0000 7f54204696c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f54100b6e00 0x7f54100c2440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.671 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.670+0000 7f54204696c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54100bd010 0x7f54100c2980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.671 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.670+0000 7f54204696c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f54100c7d40 0x7f54100c81e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.671 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.670+0000 7f54204696c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f54100c8720 con 0x7f54100bd010 2026-02-13T01:24:06.671 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.670+0000 7f54204696c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f54100c8890 con 0x7f54100c7d40 2026-02-13T01:24:06.671 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.670+0000 7f54204696c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f54100c8a50 con 0x7f54100b6e00 2026-02-13T01:24:06.673 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.670+0000 7f541e9db6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f54100c7d40 0x7f54100c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.673 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.670+0000 7f541e9db6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f54100c7d40 0x7f54100c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33500/0 (socket says 10.20.193.40:33500) 2026-02-13T01:24:06.673 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.670+0000 7f541e9db6c0 1 -- 10.20.193.40:0/3363620934 learned_addr learned my addr 10.20.193.40:0/3363620934 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.673 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.670+0000 7f541e1da6c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f54100b6e00 0x7f54100c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.673 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.671+0000 7f541d9d96c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54100bd010 0x7f54100c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.673 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.671+0000 7f541e1da6c0 1 -- 10.20.193.40:0/3363620934 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f54100c7d40 msgr2=0x7f54100c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.673 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.671+0000 7f541e1da6c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f54100c7d40 0x7f54100c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.673 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.671+0000 7f541e1da6c0 1 -- 10.20.193.40:0/3363620934 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54100bd010 msgr2=0x7f54100c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.671+0000 7f541e1da6c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54100bd010 0x7f54100c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.671+0000 7f541e1da6c0 1 -- 10.20.193.40:0/3363620934 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5408009590 con 0x7f54100b6e00 2026-02-13T01:24:06.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.671+0000 7f541e1da6c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f54100b6e00 0x7f54100c2440 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5408004750 tx=0x7f540800bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.671+0000 7f541d9d96c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54100bd010 0x7f54100c2980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:06.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.673+0000 7f37db5da6c0 1 -- 10.20.193.40:0/884111955 shutdown_connections 2026-02-13T01:24:06.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.673+0000 7f37db5da6c0 1 --2- 10.20.193.40:0/884111955 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f37d00ca7a0 0x7f37d012ad80 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=5630810355424445180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.673+0000 7f37db5da6c0 1 --2- 10.20.193.40:0/884111955 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f37d00c4a40 0x7f37d00ca100 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.673+0000 7f37db5da6c0 1 --2- 10.20.193.40:0/884111955 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f37d001d530 0x7f37d00c9bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.673+0000 7f37db5da6c0 1 -- 10.20.193.40:0/884111955 >> 10.20.193.40:0/884111955 conn(0x7f37d001c5c0 msgr2=0x7f37d001cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.673+0000 7f37db5da6c0 1 -- 10.20.193.40:0/884111955 shutdown_connections 2026-02-13T01:24:06.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.673+0000 7f37db5da6c0 1 -- 10.20.193.40:0/884111955 wait complete. 2026-02-13T01:24:06.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.674+0000 7f37db5da6c0 1 Processor -- start 2026-02-13T01:24:06.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.674+0000 7f37db5da6c0 1 -- start start 2026-02-13T01:24:06.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.674+0000 7f37db5da6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f37d001d530 0x7f37d012e260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.674+0000 7f37db5da6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f37d00c4a40 0x7f37d012ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.674+0000 7f37db5da6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f37d00ca7a0 0x7f37d012c7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37da5d86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f37d001d530 0x7f37d012e260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37da5d86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f37d001d530 0x7f37d012e260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33512/0 (socket says 10.20.193.40:33512) 2026-02-13T01:24:06.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37da5d86c0 1 -- 10.20.193.40:0/2320621916 learned_addr learned my addr 10.20.193.40:0/2320621916 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37db5da6c0 1 -- 10.20.193.40:0/2320621916 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f37d012cd40 con 0x7f37d00c4a40 2026-02-13T01:24:06.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37db5da6c0 1 -- 10.20.193.40:0/2320621916 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f37d012ceb0 con 0x7f37d001d530 2026-02-13T01:24:06.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37db5da6c0 1 -- 10.20.193.40:0/2320621916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f37d012d070 con 0x7f37d00ca7a0 2026-02-13T01:24:06.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37dadd96c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f37d00ca7a0 0x7f37d012c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37d9dd76c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f37d00c4a40 0x7f37d012ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f54077fe6c0 1 -- 10.20.193.40:0/3363620934 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5408004250 con 0x7f54100b6e00 2026-02-13T01:24:06.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f54077fe6c0 1 -- 10.20.193.40:0/3363620934 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5408002df0 con 0x7f54100b6e00 2026-02-13T01:24:06.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f54077fe6c0 1 -- 10.20.193.40:0/3363620934 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5408007440 con 0x7f54100b6e00 2026-02-13T01:24:06.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541400a5b0 con 0x7f54100b6e00 2026-02-13T01:24:06.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.676+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5410109170 con 0x7f54100b6e00 2026-02-13T01:24:06.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37dadd96c0 1 -- 10.20.193.40:0/2320621916 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f37d001d530 msgr2=0x7f37d012e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37dadd96c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f37d001d530 0x7f37d012e260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.675+0000 7f37dadd96c0 1 -- 10.20.193.40:0/2320621916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f37d00c4a40 msgr2=0x7f37d012ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.676+0000 7f37dadd96c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f37d00c4a40 0x7f37d012ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.676+0000 7f37dadd96c0 1 -- 10.20.193.40:0/2320621916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c800a660 con 0x7f37d00ca7a0 2026-02-13T01:24:06.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.676+0000 7f37d9dd76c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f37d00c4a40 0x7f37d012ac40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:06.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.676+0000 7f37dadd96c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f37d00ca7a0 0x7f37d012c7d0 secure :-1 s=READY pgs=88 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d00caba0 tx=0x7f37c800a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.680 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.678+0000 7f54077fe6c0 1 -- 10.20.193.40:0/3363620934 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f54080075d0 con 0x7f54100b6e00 2026-02-13T01:24:06.680 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.679+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5410000c60 con 0x7f54100b6e00 2026-02-13T01:24:06.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.681+0000 7f37bf7fe6c0 1 -- 10.20.193.40:0/2320621916 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37c8003a30 con 0x7f37d00ca7a0 2026-02-13T01:24:06.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.681+0000 7f37bf7fe6c0 1 -- 10.20.193.40:0/2320621916 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f37c8006580 con 0x7f37d00ca7a0 2026-02-13T01:24:06.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.681+0000 7f37bf7fe6c0 1 -- 10.20.193.40:0/2320621916 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37c8008d50 con 0x7f37d00ca7a0 2026-02-13T01:24:06.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.681+0000 7f37db5da6c0 1 -- 10.20.193.40:0/2320621916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d012d2f0 con 0x7f37d00ca7a0 2026-02-13T01:24:06.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.682+0000 7f37db5da6c0 1 -- 10.20.193.40:0/2320621916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d00b7dd0 con 0x7f37d00ca7a0 2026-02-13T01:24:06.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.682+0000 7f54077fe6c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53f40b57e0 0x7f53f40d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.683+0000 7f54077fe6c0 1 -- 10.20.193.40:0/3363620934 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f54080e3d80 con 0x7f54100b6e00 2026-02-13T01:24:06.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.683+0000 7f54077fe6c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] conn(0x7f53f40dcf40 0x7f53f40fd350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.683+0000 7f54077fe6c0 1 -- 10.20.193.40:0/3363620934 --> [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53f40fda00 con 0x7f53f40dcf40 2026-02-13T01:24:06.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.684+0000 7f54077fe6c0 1 -- 10.20.193.40:0/3363620934 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f54080e6340 con 0x7f54100b6e00 2026-02-13T01:24:06.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.684+0000 7f541d9d96c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53f40b57e0 0x7f53f40d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.685+0000 7f541d9d96c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53f40b57e0 0x7f53f40d5c90 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54100c8dd0 tx=0x7f540c005e50 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.686+0000 7f37db5da6c0 1 -- 10.20.193.40:0/2320621916 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f379c000fe0 con 0x7f37d00ca7a0 2026-02-13T01:24:06.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.690+0000 7efe317106c0 1 -- 10.20.193.40:0/832986597 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe2c1168c0 msgr2=0x7efe2c116d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.692 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.690+0000 7efe317106c0 1 --2- 10.20.193.40:0/832986597 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe2c1168c0 0x7efe2c116d40 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=11389473971406444293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe2400aa40 tx=0x7efe2402fe30 comp rx=0 tx=0).stop 2026-02-13T01:24:06.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.689+0000 7f37bf7fe6c0 1 -- 10.20.193.40:0/2320621916 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f37c8003b90 con 0x7f37d00ca7a0 2026-02-13T01:24:06.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.693+0000 7f541e9db6c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] conn(0x7f53f40dcf40 0x7f53f40fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.693+0000 7f37bf7fe6c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f37a40b58b0 0x7f37a40d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.694+0000 7f37bf7fe6c0 1 -- 10.20.193.40:0/2320621916 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f37c8108f10 con 0x7f37d00ca7a0 2026-02-13T01:24:06.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.694+0000 7f37bf7fe6c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] conn(0x7f37a40dd020 0x7f37a40fd430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.694+0000 7f37bf7fe6c0 1 -- 10.20.193.40:0/2320621916 --> [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37a40fdae0 con 0x7f37a40dd020 2026-02-13T01:24:06.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.694+0000 7f37bf7fe6c0 1 -- 10.20.193.40:0/2320621916 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f37c8109240 con 0x7f37d00ca7a0 2026-02-13T01:24:06.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.695+0000 7f37da5d86c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f37a40b58b0 0x7f37a40d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.698+0000 7f37da5d86c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f37a40b58b0 0x7f37a40d5d60 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c0009260 tx=0x7f37c0009640 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.700+0000 7f37d9dd76c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] conn(0x7f37a40dd020 0x7f37a40fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.701+0000 7f82271cb6c0 1 -- 10.20.193.40:0/2528559185 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8220116520 msgr2=0x7f822017a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.701+0000 7f82271cb6c0 1 --2- 10.20.193.40:0/2528559185 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8220116520 0x7f822017a100 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=3225159431172061145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f821c00aa70 tx=0x7f821c02fe10 comp rx=0 tx=0).stop 2026-02-13T01:24:06.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.703+0000 7f37d9dd76c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] conn(0x7f37a40dd020 0x7f37a40fd430 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.709 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.703+0000 7f82271cb6c0 1 -- 10.20.193.40:0/2528559185 shutdown_connections 2026-02-13T01:24:06.709 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.703+0000 7f82271cb6c0 1 --2- 10.20.193.40:0/2528559185 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8220116520 0x7f822017a100 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=3225159431172061145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.709 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.703+0000 7f541e9db6c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] conn(0x7f53f40dcf40 0x7f53f40fd350 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.709 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.703+0000 7f82271cb6c0 1 --2- 10.20.193.40:0/2528559185 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8220114190 0x7f8220115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.710 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f82271cb6c0 1 --2- 10.20.193.40:0/2528559185 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f82201137a0 0x7f8220113b70 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.710 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f54077fe6c0 1 -- 10.20.193.40:0/3363620934 <== osd.7 v2:10.20.193.55:6816/1340798625 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f53f40fda00 con 0x7f53f40dcf40 2026-02-13T01:24:06.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f37bf7fe6c0 1 -- 10.20.193.40:0/2320621916 <== osd.1 v2:10.20.193.55:6800/3110028162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f37a40fdae0 con 0x7f37a40dd020 2026-02-13T01:24:06.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f82271cb6c0 1 -- 10.20.193.40:0/2528559185 >> 10.20.193.40:0/2528559185 conn(0x7f8220061510 msgr2=0x7f8220061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f82271cb6c0 1 -- 10.20.193.40:0/2528559185 shutdown_connections 2026-02-13T01:24:06.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f82271cb6c0 1 -- 10.20.193.40:0/2528559185 wait complete. 2026-02-13T01:24:06.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f82271cb6c0 1 Processor -- start 2026-02-13T01:24:06.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f82271cb6c0 1 -- start start 2026-02-13T01:24:06.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7efe317106c0 1 -- 10.20.193.40:0/832986597 shutdown_connections 2026-02-13T01:24:06.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7efe317106c0 1 --2- 10.20.193.40:0/832986597 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe2c1168c0 0x7efe2c116d40 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=11389473971406444293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.712 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7efe317106c0 1 --2- 10.20.193.40:0/832986597 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2c114910 0x7efe2c116380 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7efe317106c0 1 --2- 10.20.193.40:0/832986597 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe2c114000 0x7efe2c1143d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7efe317106c0 1 -- 10.20.193.40:0/832986597 >> 10.20.193.40:0/832986597 conn(0x7efe2c0586e0 msgr2=0x7efe2c058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.713 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7efe317106c0 1 -- 10.20.193.40:0/832986597 shutdown_connections 2026-02-13T01:24:06.714 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f82271cb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f82201137a0 0x7f822011a180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.714 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7f82271cb6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8220116520 0x7f822011a6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.714 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82271cb6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f822015f040 0x7f822015f4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.714 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82271cb6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f822015fa20 con 0x7f82201137a0 2026-02-13T01:24:06.714 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82271cb6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f822015fb90 con 0x7f822015f040 2026-02-13T01:24:06.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82271cb6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f822015fd50 con 0x7f8220116520 2026-02-13T01:24:06.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82261c96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f82201137a0 0x7f822011a180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82261c96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f82201137a0 0x7f822011a180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33582/0 (socket says 10.20.193.40:33582) 2026-02-13T01:24:06.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82261c96c0 1 -- 10.20.193.40:0/3444288392 learned_addr learned my addr 10.20.193.40:0/3444288392 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82259c86c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8220116520 0x7f822011a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82269ca6c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f822015f040 0x7f822015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82261c96c0 1 -- 10.20.193.40:0/3444288392 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8220116520 msgr2=0x7f822011a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82261c96c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8220116520 0x7f822011a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82261c96c0 1 -- 10.20.193.40:0/3444288392 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f822015f040 msgr2=0x7f822015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82261c96c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f822015f040 0x7f822015f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82261c96c0 1 -- 10.20.193.40:0/3444288392 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821c00a660 con 0x7f82201137a0 2026-02-13T01:24:06.717 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.711+0000 7f82261c96c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f82201137a0 0x7f822011a180 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f821400b6c0 tx=0x7f821400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.717+0000 7f820f7fe6c0 1 -- 10.20.193.40:0/3444288392 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82140044a0 con 0x7f82201137a0 2026-02-13T01:24:06.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.717+0000 7f820f7fe6c0 1 -- 10.20.193.40:0/3444288392 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8214004600 con 0x7f82201137a0 2026-02-13T01:24:06.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.717+0000 7f820f7fe6c0 1 -- 10.20.193.40:0/3444288392 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f821400e070 con 0x7f82201137a0 2026-02-13T01:24:06.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.717+0000 7f37db5da6c0 1 -- 10.20.193.40:0/2320621916 --> [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f379c002d20 con 0x7f37a40dd020 2026-02-13T01:24:06.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.717+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8220160030 con 0x7f82201137a0 2026-02-13T01:24:06.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.717+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82201604c0 con 0x7f82201137a0 2026-02-13T01:24:06.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.708+0000 7efe317106c0 1 -- 10.20.193.40:0/832986597 wait complete. 2026-02-13T01:24:06.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.719+0000 7f37bf7fe6c0 1 -- 10.20.193.40:0/2320621916 <== osd.1 v2:10.20.193.55:6800/3110028162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f379c002d20 con 0x7f37a40dd020 2026-02-13T01:24:06.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.734+0000 7f820f7fe6c0 1 -- 10.20.193.40:0/3444288392 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8214002750 con 0x7f82201137a0 2026-02-13T01:24:06.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.740+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 --> [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54100099f0 con 0x7f53f40dcf40 2026-02-13T01:24:06.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.740+0000 7f54077fe6c0 1 -- 10.20.193.40:0/3363620934 <== osd.7 v2:10.20.193.55:6816/1340798625 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f54100099f0 con 0x7f53f40dcf40 2026-02-13T01:24:06.743 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.740+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 >> [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] conn(0x7f53f40dcf40 msgr2=0x7f53f40fd350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.743 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.742+0000 7f54204696c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.55:6816/1340798625,v1:10.20.193.55:6817/1340798625] conn(0x7f53f40dcf40 0x7f53f40fd350 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.743+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53f40b57e0 msgr2=0x7f53f40d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.743+0000 7f54204696c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53f40b57e0 0x7f53f40d5c90 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54100c8dd0 tx=0x7f540c005e50 comp rx=0 tx=0).stop 2026-02-13T01:24:06.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.743+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f54100b6e00 msgr2=0x7f54100c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.743+0000 7f54204696c0 1 --2- 10.20.193.40:0/3363620934 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f54100b6e00 0x7f54100c2440 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5408004750 tx=0x7f540800bed0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.743+0000 7f541e9db6c0 1 -- 10.20.193.40:0/3363620934 reap_dead start 2026-02-13T01:24:06.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.743+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 shutdown_connections 2026-02-13T01:24:06.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.743+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 >> 10.20.193.40:0/3363620934 conn(0x7f5410094680 msgr2=0x7f54100b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.743+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 shutdown_connections 2026-02-13T01:24:06.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.743+0000 7f54204696c0 1 -- 10.20.193.40:0/3363620934 wait complete. 2026-02-13T01:24:06.746 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.745+0000 7f820f7fe6c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f81f80b58b0 0x7f81f80d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.748 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.747+0000 7f820f7fe6c0 1 -- 10.20.193.40:0/3444288392 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f82140e3990 con 0x7f82201137a0 2026-02-13T01:24:06.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.748+0000 7f82259c86c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f81f80b58b0 0x7f81f80d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.752 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.750+0000 7f82259c86c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f81f80b58b0 0x7f81f80d5d60 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8210005980 tx=0x7f8210005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.767+0000 7efe317106c0 1 Processor -- start 2026-02-13T01:24:06.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.767+0000 7efe317106c0 1 -- start start 2026-02-13T01:24:06.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.768+0000 7efe317106c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe2c114000 0x7efe2c1618a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.768+0000 7efe317106c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2c114910 0x7efe2c161de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.769+0000 7efe317106c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe2c1168c0 0x7efe2c1671a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.769+0000 7efe317106c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c1677a0 con 0x7efe2c1168c0 2026-02-13T01:24:06.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.769+0000 7efe317106c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c167910 con 0x7efe2c114000 2026-02-13T01:24:06.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.769+0000 7efe317106c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c167ad0 con 0x7efe2c114910 2026-02-13T01:24:06.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.769+0000 7efe2affd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe2c114000 0x7efe2c1618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.769+0000 7efe2b7fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe2c1168c0 0x7efe2c1671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.769+0000 7efe2b7fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe2c1168c0 0x7efe2c1671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33588/0 (socket says 10.20.193.40:33588) 2026-02-13T01:24:06.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.769+0000 7efe2b7fe6c0 1 -- 10.20.193.40:0/3074884747 learned_addr learned my addr 10.20.193.40:0/3074884747 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.770+0000 7efe2b7fe6c0 1 -- 10.20.193.40:0/3074884747 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2c114910 msgr2=0x7efe2c161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.770+0000 7efe2a7fc6c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2c114910 0x7efe2c161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.770+0000 7efe2b7fe6c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe2c114910 0x7efe2c161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.770+0000 7efe2b7fe6c0 1 -- 10.20.193.40:0/3074884747 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe2c114000 msgr2=0x7efe2c1618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.770+0000 7efe2b7fe6c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe2c114000 0x7efe2c1618a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.770+0000 7efe2b7fe6c0 1 -- 10.20.193.40:0/3074884747 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2400a660 con 0x7efe2c1168c0 2026-02-13T01:24:06.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.770+0000 7efe2b7fe6c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe2c1168c0 0x7efe2c1671a0 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe2400ab40 tx=0x7efe240054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.771+0000 7efe0ffff6c0 1 -- 10.20.193.40:0/3074884747 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe240057b0 con 0x7efe2c1168c0 2026-02-13T01:24:06.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.771+0000 7efe0ffff6c0 1 -- 10.20.193.40:0/3074884747 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efe24003d40 con 0x7efe2c1168c0 2026-02-13T01:24:06.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.771+0000 7efe0ffff6c0 1 -- 10.20.193.40:0/3074884747 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe24032310 con 0x7efe2c1168c0 2026-02-13T01:24:06.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.771+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2c167d50 con 0x7efe2c1168c0 2026-02-13T01:24:06.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.771+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2c168310 con 0x7efe2c1168c0 2026-02-13T01:24:06.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.775+0000 7efe0ffff6c0 1 -- 10.20.193.40:0/3074884747 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7efe240324a0 con 0x7efe2c1168c0 2026-02-13T01:24:06.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.777+0000 7efe0ffff6c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe080b5760 0x7efe080d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.777+0000 7efe0ffff6c0 1 -- 10.20.193.40:0/3074884747 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7efe24109150 con 0x7efe2c1168c0 2026-02-13T01:24:06.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.775+0000 7f245440c6c0 1 -- 10.20.193.40:0/403425629 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f244c1149f0 msgr2=0x7f244c116380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.775+0000 7f245440c6c0 1 --2- 10.20.193.40:0/403425629 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f244c1149f0 0x7f244c116380 secure :-1 s=READY pgs=89 gs=2 cs=0 l=1 c_cookie=17877958392193673474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2440009970 tx=0x7f244002ed70 comp rx=0 tx=0).stop 2026-02-13T01:24:06.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.782+0000 7efe2affd6c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe080b5760 0x7efe080d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.783+0000 7f82271cb6c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] conn(0x7f81e8001600 0x7f81e8021ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.783+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 --> [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81e8024c10 con 0x7f81e8001600 2026-02-13T01:24:06.787 INFO:teuthology.orchestra.run.trial040.stdout:141733920788 2026-02-13T01:24:06.787 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T01:24:06.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7efe2affd6c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe080b5760 0x7efe080d5c10 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe18004770 tx=0x7efe18006d50 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7efe317106c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] conn(0x7efdf8001600 0x7efdf8021ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 --> [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdf8024c10 con 0x7efdf8001600 2026-02-13T01:24:06.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7efe2a7fc6c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] conn(0x7efdf8001600 0x7efdf8021ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7efe2a7fc6c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] conn(0x7efdf8001600 0x7efdf8021ab0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f82269ca6c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] conn(0x7f81e8001600 0x7f81e8021ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7efe0ffff6c0 1 -- 10.20.193.40:0/3074884747 <== osd.3 v2:10.20.193.40:6810/485777007 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7efdf8024c10 con 0x7efdf8001600 2026-02-13T01:24:06.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f37bd7fa6c0 1 -- 10.20.193.40:0/2320621916 >> [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] conn(0x7f37a40dd020 msgr2=0x7f37a40fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f37bd7fa6c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.55:6800/3110028162,v1:10.20.193.55:6801/3110028162] conn(0x7f37a40dd020 0x7f37a40fd430 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f37bd7fa6c0 1 -- 10.20.193.40:0/2320621916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f37a40b58b0 msgr2=0x7f37a40d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f37bd7fa6c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f37a40b58b0 0x7f37a40d5d60 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c0009260 tx=0x7f37c0009640 comp rx=0 tx=0).stop 2026-02-13T01:24:06.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f37bd7fa6c0 1 -- 10.20.193.40:0/2320621916 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f37d00ca7a0 msgr2=0x7f37d012c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f37bd7fa6c0 1 --2- 10.20.193.40:0/2320621916 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f37d00ca7a0 0x7f37d012c7d0 secure :-1 s=READY pgs=88 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d00caba0 tx=0x7f37c800a250 comp rx=0 tx=0).stop 2026-02-13T01:24:06.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f37dadd96c0 1 -- 10.20.193.40:0/2320621916 reap_dead start 2026-02-13T01:24:06.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f37bd7fa6c0 1 -- 10.20.193.40:0/2320621916 shutdown_connections 2026-02-13T01:24:06.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.784+0000 7f37bd7fa6c0 1 -- 10.20.193.40:0/2320621916 >> 10.20.193.40:0/2320621916 conn(0x7f37d001c5c0 msgr2=0x7f37d00c81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.792+0000 7f37bd7fa6c0 1 -- 10.20.193.40:0/2320621916 shutdown_connections 2026-02-13T01:24:06.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.792+0000 7f37bd7fa6c0 1 -- 10.20.193.40:0/2320621916 wait complete. 2026-02-13T01:24:06.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.792+0000 7f82269ca6c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] conn(0x7f81e8001600 0x7f81e8021ab0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.792+0000 7f820f7fe6c0 1 -- 10.20.193.40:0/3444288392 <== osd.4 v2:10.20.193.55:6808/3166522039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f81e8024c10 con 0x7f81e8001600 2026-02-13T01:24:06.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.798+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/4056478884 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f84116990 msgr2=0x7f7f8417a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.798+0000 7f7f8a0b36c0 1 --2- 10.20.193.40:0/4056478884 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f84116990 0x7f7f8417a5a0 secure :-1 s=READY pgs=90 gs=3 cs=0 l=1 c_cookie=17010860547229921747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f80006fd0 tx=0x7f7f8002fd40 comp rx=0 tx=0).stop 2026-02-13T01:24:06.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/4056478884 shutdown_connections 2026-02-13T01:24:06.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 --2- 10.20.193.40:0/4056478884 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f84116990 0x7f7f8417a5a0 unknown :-1 s=CLOSED pgs=90 gs=3 cs=0 l=1 c_cookie=17010860547229921747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 --2- 10.20.193.40:0/4056478884 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f841149f0 0x7f7f841161e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 --2- 10.20.193.40:0/4056478884 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f84114000 0x7f7f841143d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/4056478884 >> 10.20.193.40:0/4056478884 conn(0x7f7f8405aaa0 msgr2=0x7f7f8405b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 --> [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efdf8023d00 con 0x7efdf8001600 2026-02-13T01:24:06.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe0ffff6c0 1 -- 10.20.193.40:0/3074884747 <== osd.3 v2:10.20.193.40:6810/485777007 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efdf8023d00 con 0x7efdf8001600 2026-02-13T01:24:06.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] conn(0x7efdf8001600 msgr2=0x7efdf8021ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6810/485777007,v1:10.20.193.40:6811/485777007] conn(0x7efdf8001600 0x7efdf8021ab0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/4056478884 shutdown_connections 2026-02-13T01:24:06.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/4056478884 wait complete. 2026-02-13T01:24:06.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe080b5760 msgr2=0x7efe080d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe080b5760 0x7efe080d5c10 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe18004770 tx=0x7efe18006d50 comp rx=0 tx=0).stop 2026-02-13T01:24:06.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe2c1168c0 msgr2=0x7efe2c1671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 --2- 10.20.193.40:0/3074884747 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe2c1168c0 0x7efe2c1671a0 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe2400ab40 tx=0x7efe240054b0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe2b7fe6c0 1 -- 10.20.193.40:0/3074884747 reap_dead start 2026-02-13T01:24:06.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 shutdown_connections 2026-02-13T01:24:06.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 >> 10.20.193.40:0/3074884747 conn(0x7efe2c0586e0 msgr2=0x7efe2c119550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 Processor -- start 2026-02-13T01:24:06.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 -- start start 2026-02-13T01:24:06.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 shutdown_connections 2026-02-13T01:24:06.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7efe317106c0 1 -- 10.20.193.40:0/3074884747 wait complete. 2026-02-13T01:24:06.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f84114000 0x7f7f84185c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f84116990 0x7f7f84186160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f84186790 0x7f7f8415b510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 --> [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f81e8023ca0 con 0x7f81e8001600 2026-02-13T01:24:06.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8415bca0 con 0x7f7f84186790 2026-02-13T01:24:06.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8415be10 con 0x7f7f84114000 2026-02-13T01:24:06.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f8a0b36c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8415bfd0 con 0x7f7f84116990 2026-02-13T01:24:06.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.800+0000 7f7f890b16c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f84114000 0x7f7f84185c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f888b06c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f84116990 0x7f7f84186160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f890b16c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f84114000 0x7f7f84185c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33564/0 (socket says 10.20.193.40:33564) 2026-02-13T01:24:06.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f890b16c0 1 -- 10.20.193.40:0/2416356009 learned_addr learned my addr 10.20.193.40:0/2416356009 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f898b26c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f84186790 0x7f7f8415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f898b26c0 1 -- 10.20.193.40:0/2416356009 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f84116990 msgr2=0x7f7f84186160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f898b26c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f84116990 0x7f7f84186160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f898b26c0 1 -- 10.20.193.40:0/2416356009 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f84114000 msgr2=0x7f7f84185c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f898b26c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f84114000 0x7f7f84185c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f898b26c0 1 -- 10.20.193.40:0/2416356009 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8000a5b0 con 0x7f7f84186790 2026-02-13T01:24:06.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.806+0000 7f7f898b26c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f84186790 0x7f7f8415b510 secure :-1 s=READY pgs=222 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f8000a580 tx=0x7f7f80003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f820f7fe6c0 1 -- 10.20.193.40:0/3444288392 <== osd.4 v2:10.20.193.55:6808/3166522039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f81e8023ca0 con 0x7f81e8001600 2026-02-13T01:24:06.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f7f727fc6c0 1 -- 10.20.193.40:0/2416356009 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f80003dd0 con 0x7f7f84186790 2026-02-13T01:24:06.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f7f727fc6c0 1 -- 10.20.193.40:0/2416356009 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7f800081c0 con 0x7f7f84186790 2026-02-13T01:24:06.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 >> [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] conn(0x7f81e8001600 msgr2=0x7f81e8021ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.55:6808/3166522039,v1:10.20.193.55:6809/3166522039] conn(0x7f81e8001600 0x7f81e8021ab0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f81f80b58b0 msgr2=0x7f81f80d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f81f80b58b0 0x7f81f80d5d60 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8210005980 tx=0x7f8210005910 comp rx=0 tx=0).stop 2026-02-13T01:24:06.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f82201137a0 msgr2=0x7f822011a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 --2- 10.20.193.40:0/3444288392 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f82201137a0 0x7f822011a180 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f821400b6c0 tx=0x7f821400bb90 comp rx=0 tx=0).stop 2026-02-13T01:24:06.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f7f727fc6c0 1 -- 10.20.193.40:0/2416356009 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f800365c0 con 0x7f7f84186790 2026-02-13T01:24:06.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8415c250 con 0x7f7f84186790 2026-02-13T01:24:06.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8415c650 con 0x7f7f84186790 2026-02-13T01:24:06.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f4c000fe0 con 0x7f7f84186790 2026-02-13T01:24:06.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/2543561128 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7faa98119950 msgr2=0x7faa9817a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7faa9e77d6c0 1 --2- 10.20.193.40:0/2543561128 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7faa98119950 0x7faa9817a2f0 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=17559030718321095719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c00a9b0 tx=0x7faa8c02fd50 comp rx=0 tx=0).stop 2026-02-13T01:24:06.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/2543561128 shutdown_connections 2026-02-13T01:24:06.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7faa9e77d6c0 1 --2- 10.20.193.40:0/2543561128 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7faa98119950 0x7faa9817a2f0 unknown :-1 s=CLOSED pgs=91 gs=2 cs=0 l=1 c_cookie=17559030718321095719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7faa9e77d6c0 1 --2- 10.20.193.40:0/2543561128 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7faa98114130 0x7faa98119170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7faa9e77d6c0 1 --2- 10.20.193.40:0/2543561128 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faa98113740 0x7faa98113b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/2543561128 >> 10.20.193.40:0/2543561128 conn(0x7faa980610f0 msgr2=0x7faa980614f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/2543561128 shutdown_connections 2026-02-13T01:24:06.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/2543561128 wait complete. 2026-02-13T01:24:06.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82269ca6c0 1 -- 10.20.193.40:0/3444288392 reap_dead start 2026-02-13T01:24:06.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 shutdown_connections 2026-02-13T01:24:06.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 >> 10.20.193.40:0/3444288392 conn(0x7f8220061510 msgr2=0x7f82201172f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa9e77d6c0 1 Processor -- start 2026-02-13T01:24:06.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa9e77d6c0 1 -- start start 2026-02-13T01:24:06.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa9e77d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faa98113740 0x7faa9811a370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa9e77d6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7faa98119950 0x7faa9811a8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa9e77d6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7faa9815f230 0x7faa9815f6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa97fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faa98113740 0x7faa9811a370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa9e77d6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7faa9815fc10 con 0x7faa98113740 2026-02-13T01:24:06.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa9ccef6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7faa9815f230 0x7faa9815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa9ccef6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7faa9815f230 0x7faa9815f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:51900/0 (socket says 10.20.193.40:51900) 2026-02-13T01:24:06.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa9ccef6c0 1 -- 10.20.193.40:0/1340395483 learned_addr learned my addr 10.20.193.40:0/1340395483 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7faa977fe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7faa98119950 0x7faa9811a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7faa9815fd80 con 0x7faa98119950 2026-02-13T01:24:06.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7faa9815ff40 con 0x7faa9815f230 2026-02-13T01:24:06.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa97fff6c0 1 -- 10.20.193.40:0/1340395483 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7faa9815f230 msgr2=0x7faa9815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa97fff6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7faa9815f230 0x7faa9815f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa97fff6c0 1 -- 10.20.193.40:0/1340395483 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7faa98119950 msgr2=0x7faa9811a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 shutdown_connections 2026-02-13T01:24:06.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.808+0000 7f82271cb6c0 1 -- 10.20.193.40:0/3444288392 wait complete. 2026-02-13T01:24:06.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa97fff6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7faa98119950 0x7faa9811a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa97fff6c0 1 -- 10.20.193.40:0/1340395483 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa84009590 con 0x7faa98113740 2026-02-13T01:24:06.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa97fff6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faa98113740 0x7faa9811a370 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa84004750 tx=0x7faa8400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa957fa6c0 1 -- 10.20.193.40:0/1340395483 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa84004560 con 0x7faa98113740 2026-02-13T01:24:06.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa957fa6c0 1 -- 10.20.193.40:0/1340395483 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7faa84009030 con 0x7faa98113740 2026-02-13T01:24:06.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7f245440c6c0 1 -- 10.20.193.40:0/403425629 shutdown_connections 2026-02-13T01:24:06.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7f245440c6c0 1 --2- 10.20.193.40:0/403425629 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f244c116b30 0x7f244c17a760 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7f245440c6c0 1 --2- 10.20.193.40:0/403425629 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f244c1149f0 0x7f244c116380 unknown :-1 s=CLOSED pgs=89 gs=2 cs=0 l=1 c_cookie=17877958392193673474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7f245440c6c0 1 --2- 10.20.193.40:0/403425629 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f244c114000 0x7f244c1143d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7f245440c6c0 1 -- 10.20.193.40:0/403425629 >> 10.20.193.40:0/403425629 conn(0x7f244c0586e0 msgr2=0x7f244c058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7faa957fa6c0 1 -- 10.20.193.40:0/1340395483 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa84007440 con 0x7faa98113740 2026-02-13T01:24:06.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 -- 10.20.193.40:0/403425629 shutdown_connections 2026-02-13T01:24:06.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8c00a5b0 con 0x7faa98113740 2026-02-13T01:24:06.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa981604f0 con 0x7faa98113740 2026-02-13T01:24:06.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 -- 10.20.193.40:0/403425629 wait complete. 2026-02-13T01:24:06.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 Processor -- start 2026-02-13T01:24:06.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 -- start start 2026-02-13T01:24:06.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f244c114000 0x7f244c0ff0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f244c116b30 0x7f244c17a760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f244c0ff7a0 0x7f244c1049b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f244c104ef0 con 0x7f244c114000 2026-02-13T01:24:06.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f244c105060 con 0x7f244c116b30 2026-02-13T01:24:06.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f245440c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f244c105220 con 0x7f244c0ff7a0 2026-02-13T01:24:06.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f24529826c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f244c0ff7a0 0x7f244c1049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f24529826c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f244c0ff7a0 0x7f244c1049b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:51910/0 (socket says 10.20.193.40:51910) 2026-02-13T01:24:06.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f24529826c0 1 -- 10.20.193.40:0/2294997662 learned_addr learned my addr 10.20.193.40:0/2294997662 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.824+0000 7f24521816c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f244c114000 0x7f244c0ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.826+0000 7f24519806c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f244c116b30 0x7f244c17a760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.814+0000 7f7f727fc6c0 1 -- 10.20.193.40:0/2416356009 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7f80036720 con 0x7f7f84186790 2026-02-13T01:24:06.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7f7f727fc6c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7f600b5730 0x7f7f600d5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7f7f727fc6c0 1 -- 10.20.193.40:0/2416356009 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f7f80108d10 con 0x7f7f84186790 2026-02-13T01:24:06.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.816+0000 7f7f890b16c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7f600b5730 0x7f7f600d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f7f727fc6c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] conn(0x7f7f600dcea0 0x7f7f600fd2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.821+0000 7f7f727fc6c0 1 -- 10.20.193.40:0/2416356009 --> [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f600fd960 con 0x7f7f600dcea0 2026-02-13T01:24:06.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.823+0000 7f7f888b06c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] conn(0x7f7f600dcea0 0x7f7f600fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.827+0000 7f24529826c0 1 -- 10.20.193.40:0/2294997662 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f244c116b30 msgr2=0x7f244c17a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.826+0000 7f7f890b16c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7f600b5730 0x7f7f600d5be0 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f7400af50 tx=0x7f7f7400ad10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.827+0000 7f24529826c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f244c116b30 0x7f244c17a760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.827+0000 7f24529826c0 1 -- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f244c114000 msgr2=0x7f244c0ff0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.829+0000 7f7f727fc6c0 1 -- 10.20.193.40:0/2416356009 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f7f8010b3a0 con 0x7f7f84186790 2026-02-13T01:24:06.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.830+0000 7f24529826c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f244c114000 0x7f244c0ff0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.830+0000 7f24529826c0 1 -- 10.20.193.40:0/2294997662 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c0094c0 con 0x7f244c0ff7a0 2026-02-13T01:24:06.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.830+0000 7f7f888b06c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] conn(0x7f7f600dcea0 0x7f7f600fd2b0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.830+0000 7f24521816c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f244c114000 0x7f244c0ff0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:06.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.831+0000 7f24529826c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f244c0ff7a0 0x7f244c1049b0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f244800c6c0 tx=0x7f244800cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.831+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa98052a50 con 0x7faa98113740 2026-02-13T01:24:06.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.831+0000 7f243b7fe6c0 1 -- 10.20.193.40:0/2294997662 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2448003a30 con 0x7f244c0ff7a0 2026-02-13T01:24:06.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.831+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2440009590 con 0x7f244c0ff7a0 2026-02-13T01:24:06.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.831+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f244c105820 con 0x7f244c0ff7a0 2026-02-13T01:24:06.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.831+0000 7f243b7fe6c0 1 -- 10.20.193.40:0/2294997662 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2448005550 con 0x7f244c0ff7a0 2026-02-13T01:24:06.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.831+0000 7f243b7fe6c0 1 -- 10.20.193.40:0/2294997662 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2448003a30 con 0x7f244c0ff7a0 2026-02-13T01:24:06.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.832+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f244c052a50 con 0x7f244c0ff7a0 2026-02-13T01:24:06.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.834+0000 7f054aa366c0 1 -- 10.20.193.40:0/3235579020 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f054410fa50 msgr2=0x7f0544114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.834+0000 7f054aa366c0 1 --2- 10.20.193.40:0/3235579020 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f054410fa50 0x7f0544114a90 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=1551524675668171703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05380099a0 tx=0x7f053802ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:06.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.835+0000 7f054aa366c0 1 -- 10.20.193.40:0/3235579020 shutdown_connections 2026-02-13T01:24:06.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.835+0000 7f054aa366c0 1 --2- 10.20.193.40:0/3235579020 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0544115270 0x7f0544175c10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.835+0000 7f054aa366c0 1 --2- 10.20.193.40:0/3235579020 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f054410fa50 0x7f0544114a90 unknown :-1 s=CLOSED pgs=92 gs=2 cs=0 l=1 c_cookie=1551524675668171703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.835+0000 7f054aa366c0 1 --2- 10.20.193.40:0/3235579020 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f054410f060 0x7f054410f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.835+0000 7f054aa366c0 1 -- 10.20.193.40:0/3235579020 >> 10.20.193.40:0/3235579020 conn(0x7f05440ec980 msgr2=0x7f054410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.834+0000 7f243b7fe6c0 1 -- 10.20.193.40:0/2294997662 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f244800dca0 con 0x7f244c0ff7a0 2026-02-13T01:24:06.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.835+0000 7f7f727fc6c0 1 -- 10.20.193.40:0/2416356009 <== osd.8 v2:10.20.193.118:6816/2741939670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f7f600fd960 con 0x7f7f600dcea0 2026-02-13T01:24:06.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.836+0000 7f054aa366c0 1 -- 10.20.193.40:0/3235579020 shutdown_connections 2026-02-13T01:24:06.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.836+0000 7f054aa366c0 1 -- 10.20.193.40:0/3235579020 wait complete. 2026-02-13T01:24:06.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.836+0000 7f243b7fe6c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f24200b5740 0x7f24200d5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.836+0000 7f243b7fe6c0 1 -- 10.20.193.40:0/2294997662 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f24480e57f0 con 0x7f244c0ff7a0 2026-02-13T01:24:06.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.836+0000 7f24521816c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f24200b5740 0x7f24200d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.837+0000 7f243b7fe6c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] conn(0x7f24200dceb0 0x7f24200fd2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.837+0000 7f243b7fe6c0 1 -- 10.20.193.40:0/2294997662 --> [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24200fd970 con 0x7f24200dceb0 2026-02-13T01:24:06.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.837+0000 7f243b7fe6c0 1 -- 10.20.193.40:0/2294997662 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f24480e5c10 con 0x7f244c0ff7a0 2026-02-13T01:24:06.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.837+0000 7f24521816c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f24200b5740 0x7f24200d5bf0 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f243c004750 tx=0x7f243c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.840+0000 7f054aa366c0 1 Processor -- start 2026-02-13T01:24:06.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.841+0000 7f054aa366c0 1 -- start start 2026-02-13T01:24:06.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.843+0000 7f054aa366c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f054410f060 0x7f05440666e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.843+0000 7f054aa366c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0544115270 0x7f0544175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.845+0000 7f054aa366c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0544062940 0x7f0544062de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.845+0000 7f054aa366c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0544063570 con 0x7f0544115270 2026-02-13T01:24:06.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.845+0000 7f054aa366c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f05440636e0 con 0x7f054410f060 2026-02-13T01:24:06.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.845+0000 7f054aa366c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f05440fed10 con 0x7f0544062940 2026-02-13T01:24:06.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.845+0000 7f05492336c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0544115270 0x7f0544175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.846+0000 7f05492336c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0544115270 0x7f0544175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33684/0 (socket says 10.20.193.40:33684) 2026-02-13T01:24:06.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.846+0000 7f05492336c0 1 -- 10.20.193.40:0/775151252 learned_addr learned my addr 10.20.193.40:0/775151252 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.846+0000 7f0549a346c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f054410f060 0x7f05440666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.846+0000 7f054a2356c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0544062940 0x7f0544062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.848+0000 7f05492336c0 1 -- 10.20.193.40:0/775151252 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0544062940 msgr2=0x7f0544062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.848+0000 7f05492336c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0544062940 0x7f0544062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.848+0000 7f05492336c0 1 -- 10.20.193.40:0/775151252 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f054410f060 msgr2=0x7f05440666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.848+0000 7f05492336c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f054410f060 0x7f05440666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.848+0000 7f05492336c0 1 -- 10.20.193.40:0/775151252 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0538009590 con 0x7f0544115270 2026-02-13T01:24:06.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.848+0000 7f054a2356c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0544062940 0x7f0544062de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:06.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.849+0000 7f05492336c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0544115270 0x7f0544175b10 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0538005b20 tx=0x7f05380028e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.849+0000 7f0532ffd6c0 1 -- 10.20.193.40:0/775151252 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f053802fdb0 con 0x7f0544115270 2026-02-13T01:24:06.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.850+0000 7f0532ffd6c0 1 -- 10.20.193.40:0/775151252 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0538031030 con 0x7f0544115270 2026-02-13T01:24:06.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.850+0000 7f0532ffd6c0 1 -- 10.20.193.40:0/775151252 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0538007790 con 0x7f0544115270 2026-02-13T01:24:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.850+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05440fef90 con 0x7f0544115270 2026-02-13T01:24:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.851+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 --> [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f4c002d20 con 0x7f7f600dcea0 2026-02-13T01:24:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.852+0000 7f7f727fc6c0 1 -- 10.20.193.40:0/2416356009 <== osd.8 v2:10.20.193.118:6816/2741939670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7f4c002d20 con 0x7f7f600dcea0 2026-02-13T01:24:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.838+0000 7f24519806c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] conn(0x7f24200dceb0 0x7f24200fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.839+0000 7f24519806c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] conn(0x7f24200dceb0 0x7f24200fd2c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.840+0000 7f243b7fe6c0 1 -- 10.20.193.40:0/2294997662 <== osd.6 v2:10.20.193.40:6818/3706078337 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f24200fd970 con 0x7f24200dceb0 2026-02-13T01:24:06.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.852+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 --> [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f244c17e030 con 0x7f24200dceb0 2026-02-13T01:24:06.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.852+0000 7f243b7fe6c0 1 -- 10.20.193.40:0/2294997662 <== osd.6 v2:10.20.193.40:6818/3706078337 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f244c17e030 con 0x7f24200dceb0 2026-02-13T01:24:06.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.853+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] conn(0x7f24200dceb0 msgr2=0x7f24200fd2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.853+0000 7f245440c6c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6818/3706078337,v1:10.20.193.40:6819/3706078337] conn(0x7f24200dceb0 0x7f24200fd2c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.852+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05440ff440 con 0x7f0544115270 2026-02-13T01:24:06.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.853+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f24200b5740 msgr2=0x7f24200d5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.853+0000 7f245440c6c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f24200b5740 0x7f24200d5bf0 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f243c004750 tx=0x7f243c009260 comp rx=0 tx=0).stop 2026-02-13T01:24:06.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.853+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f244c0ff7a0 msgr2=0x7f244c1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.853+0000 7f245440c6c0 1 --2- 10.20.193.40:0/2294997662 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f244c0ff7a0 0x7f244c1049b0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f244800c6c0 tx=0x7f244800cb90 comp rx=0 tx=0).stop 2026-02-13T01:24:06.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.853+0000 7f24529826c0 1 -- 10.20.193.40:0/2294997662 reap_dead start 2026-02-13T01:24:06.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.852+0000 7faa957fa6c0 1 -- 10.20.193.40:0/1340395483 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7faa8400c610 con 0x7faa98113740 2026-02-13T01:24:06.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.853+0000 7f05195986c0 1 -- 10.20.193.40:0/587264507 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f051410cde0 msgr2=0x7f051410d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.853+0000 7f05195986c0 1 --2- 10.20.193.40:0/587264507 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f051410cde0 0x7f051410d1b0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=602527981735913257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05000099a0 tx=0x7f050002ed40 comp rx=0 tx=0).stop 2026-02-13T01:24:06.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.854+0000 7f05195986c0 1 -- 10.20.193.40:0/587264507 shutdown_connections 2026-02-13T01:24:06.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.854+0000 7f05195986c0 1 --2- 10.20.193.40:0/587264507 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0514112ff0 0x7f0514173990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.854+0000 7f05195986c0 1 --2- 10.20.193.40:0/587264507 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f051410d7d0 0x7f0514112810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.854+0000 7f05195986c0 1 --2- 10.20.193.40:0/587264507 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f051410cde0 0x7f051410d1b0 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=602527981735913257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f05195986c0 1 -- 10.20.193.40:0/587264507 >> 10.20.193.40:0/587264507 conn(0x7f05140ea6a0 msgr2=0x7f051410aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 >> [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] conn(0x7f7f600dcea0 msgr2=0x7f7f600fd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f7f8a0b36c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.118:6816/2741939670,v1:10.20.193.118:6817/2741939670] conn(0x7f7f600dcea0 0x7f7f600fd2b0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7f600b5730 msgr2=0x7f7f600d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f7f8a0b36c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7f600b5730 0x7f7f600d5be0 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f7400af50 tx=0x7f7f7400ad10 comp rx=0 tx=0).stop 2026-02-13T01:24:06.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f84186790 msgr2=0x7f7f8415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f7f8a0b36c0 1 --2- 10.20.193.40:0/2416356009 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f84186790 0x7f7f8415b510 secure :-1 s=READY pgs=222 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f8000a580 tx=0x7f7f80003a40 comp rx=0 tx=0).stop 2026-02-13T01:24:06.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f7f898b26c0 1 -- 10.20.193.40:0/2416356009 reap_dead start 2026-02-13T01:24:06.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f05195986c0 1 -- 10.20.193.40:0/587264507 shutdown_connections 2026-02-13T01:24:06.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f05195986c0 1 -- 10.20.193.40:0/587264507 wait complete. 2026-02-13T01:24:06.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.857+0000 7f05195986c0 1 Processor -- start 2026-02-13T01:24:06.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.857+0000 7f05195986c0 1 -- start start 2026-02-13T01:24:06.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.857+0000 7f05195986c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f051410cde0 0x7f0514119610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.857+0000 7f05195986c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0514112ff0 0x7f0514119b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f0513fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f051410cde0 0x7f0514119610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f0513fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f051410cde0 0x7f0514119610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33618/0 (socket says 10.20.193.40:33618) 2026-02-13T01:24:06.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f0513fff6c0 1 -- 10.20.193.40:0/1056154821 learned_addr learned my addr 10.20.193.40:0/1056154821 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f05137fe6c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0514112ff0 0x7f0514119b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f05195986c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f051411ef10 0x7f051411f3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f051411f920 con 0x7f051411ef10 2026-02-13T01:24:06.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f051411fa90 con 0x7f051410cde0 2026-02-13T01:24:06.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f051411fc50 con 0x7f0514112ff0 2026-02-13T01:24:06.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 shutdown_connections 2026-02-13T01:24:06.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.858+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 >> 10.20.193.40:0/2416356009 conn(0x7f7f8405aaa0 msgr2=0x7f7f84117500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.859+0000 7f05137fe6c0 1 -- 10.20.193.40:0/1056154821 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f051410cde0 msgr2=0x7f0514119610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.859+0000 7f05137fe6c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f051410cde0 0x7f0514119610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.859+0000 7f05137fe6c0 1 -- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f051411ef10 msgr2=0x7f051411f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.859+0000 7f05137fe6c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f051411ef10 0x7f051411f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.859+0000 7f05137fe6c0 1 -- 10.20.193.40:0/1056154821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0500009590 con 0x7f0514112ff0 2026-02-13T01:24:06.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.859+0000 7f05137fe6c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0514112ff0 0x7f0514119b50 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0504004750 tx=0x7f050400bb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 shutdown_connections 2026-02-13T01:24:06.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 >> 10.20.193.40:0/2294997662 conn(0x7f244c0586e0 msgr2=0x7f244c117360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 shutdown_connections 2026-02-13T01:24:06.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.855+0000 7f245440c6c0 1 -- 10.20.193.40:0/2294997662 wait complete. 2026-02-13T01:24:06.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.859+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 shutdown_connections 2026-02-13T01:24:06.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.860+0000 7faa957fa6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7faa6c0b56b0 0x7faa6c0d5b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.860+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0544052a50 con 0x7f0544115270 2026-02-13T01:24:06.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.860+0000 7f7f8a0b36c0 1 -- 10.20.193.40:0/2416356009 wait complete. 2026-02-13T01:24:06.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.860+0000 7f05117fa6c0 1 -- 10.20.193.40:0/1056154821 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0504004a80 con 0x7f0514112ff0 2026-02-13T01:24:06.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.860+0000 7f05117fa6c0 1 -- 10.20.193.40:0/1056154821 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0504009030 con 0x7f0514112ff0 2026-02-13T01:24:06.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.860+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0514160100 con 0x7f0514112ff0 2026-02-13T01:24:06.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.861+0000 7f05117fa6c0 1 -- 10.20.193.40:0/1056154821 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05040071c0 con 0x7f0514112ff0 2026-02-13T01:24:06.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.861+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0514160590 con 0x7f0514112ff0 2026-02-13T01:24:06.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.864+0000 7f0532ffd6c0 1 -- 10.20.193.40:0/775151252 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f05380317f0 con 0x7f0544115270 2026-02-13T01:24:06.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.868+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0514052a50 con 0x7f0514112ff0 2026-02-13T01:24:06.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.869+0000 7f05117fa6c0 1 -- 10.20.193.40:0/1056154821 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f0504004fe0 con 0x7f0514112ff0 2026-02-13T01:24:06.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.870+0000 7f05117fa6c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f04e80b57b0 0x7f04e80d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.873 INFO:teuthology.orchestra.run.trial040.stdout:188978561040 2026-02-13T01:24:06.873 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T01:24:06.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.871+0000 7f0513fff6c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f04e80b57b0 0x7f04e80d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.872+0000 7f05117fa6c0 1 -- 10.20.193.40:0/1056154821 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f05040aa8f0 con 0x7f0514112ff0 2026-02-13T01:24:06.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f0513fff6c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f04e80b57b0 0x7f04e80d5c60 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05000023e0 tx=0x7f0500005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f0532ffd6c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f051c0b5760 0x7f051c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f05117fa6c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] conn(0x7f04e80ddbd0 0x7f04e80fe060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.875+0000 7f05117fa6c0 1 -- 10.20.193.40:0/1056154821 --> [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04e80fe7b0 con 0x7f04e80ddbd0 2026-02-13T01:24:06.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.875+0000 7f05117fa6c0 1 -- 10.20.193.40:0/1056154821 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f05040a6540 con 0x7f0514112ff0 2026-02-13T01:24:06.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.869+0000 7f8053ca06c0 1 -- 10.20.193.40:0/3839677142 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f804c114000 msgr2=0x7f804c1143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.869+0000 7f8053ca06c0 1 --2- 10.20.193.40:0/3839677142 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f804c114000 0x7f804c1143d0 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=8708603321154053283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f803c00bb30 tx=0x7f803c030ef0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.869+0000 7f8053ca06c0 1 -- 10.20.193.40:0/3839677142 shutdown_connections 2026-02-13T01:24:06.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.869+0000 7f8053ca06c0 1 --2- 10.20.193.40:0/3839677142 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f804c119bb0 0x7f804c17a550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.869+0000 7f8053ca06c0 1 --2- 10.20.193.40:0/3839677142 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f804c1149f0 0x7f804c1193d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.869+0000 7f8053ca06c0 1 --2- 10.20.193.40:0/3839677142 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f804c114000 0x7f804c1143d0 unknown :-1 s=CLOSED pgs=83 gs=1 cs=0 l=1 c_cookie=8708603321154053283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.869+0000 7f8053ca06c0 1 -- 10.20.193.40:0/3839677142 >> 10.20.193.40:0/3839677142 conn(0x7f804c05bb70 msgr2=0x7f804c05c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.870+0000 7f8053ca06c0 1 -- 10.20.193.40:0/3839677142 shutdown_connections 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.870+0000 7f8053ca06c0 1 -- 10.20.193.40:0/3839677142 wait complete. 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.872+0000 7f8053ca06c0 1 Processor -- start 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.872+0000 7f8053ca06c0 1 -- start start 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f8053ca06c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f804c114000 0x7f804c121750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f8053ca06c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f804c119bb0 0x7f804c121c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f8053ca06c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f804c127000 0x7f804c1274a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f80512106c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f804c119bb0 0x7f804c121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f80512106c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f804c119bb0 0x7f804c121c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33634/0 (socket says 10.20.193.40:33634) 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f80512106c0 1 -- 10.20.193.40:0/965854678 learned_addr learned my addr 10.20.193.40:0/965854678 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f80522126c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f804c127000 0x7f804c1274a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.874+0000 7f8053ca06c0 1 -- 10.20.193.40:0/965854678 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f804c127a10 con 0x7f804c114000 2026-02-13T01:24:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.874+0000 7f8053ca06c0 1 -- 10.20.193.40:0/965854678 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f804c127b80 con 0x7f804c119bb0 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.874+0000 7f8051a116c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f804c114000 0x7f804c121750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.874+0000 7f8053ca06c0 1 -- 10.20.193.40:0/965854678 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f804c127d40 con 0x7f804c127000 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.874+0000 7f80512106c0 1 -- 10.20.193.40:0/965854678 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f804c127000 msgr2=0x7f804c1274a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.874+0000 7f80512106c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f804c127000 0x7f804c1274a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.874+0000 7f80512106c0 1 -- 10.20.193.40:0/965854678 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f804c114000 msgr2=0x7f804c121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.874+0000 7f80512106c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f804c114000 0x7f804c121750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.874+0000 7f80512106c0 1 -- 10.20.193.40:0/965854678 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80400081d0 con 0x7f804c119bb0 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.876+0000 7f80522126c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f804c127000 0x7f804c1274a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.876+0000 7f8051a116c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f804c114000 0x7f804c121750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:06.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.877+0000 7f80512106c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f804c119bb0 0x7f804c121c90 secure :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8040009f40 tx=0x7f804000be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.873+0000 7f0532ffd6c0 1 -- 10.20.193.40:0/775151252 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f0538108590 con 0x7f0544115270 2026-02-13T01:24:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.875+0000 7f0549a346c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f051c0b5760 0x7f051c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.875+0000 7f0532ffd6c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] conn(0x7f051c0dced0 0x7f051c0fd2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.875+0000 7f0532ffd6c0 1 -- 10.20.193.40:0/775151252 --> [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f051c0fd990 con 0x7f051c0dced0 2026-02-13T01:24:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.875+0000 7f0532ffd6c0 1 -- 10.20.193.40:0/775151252 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f0538108890 con 0x7f0544115270 2026-02-13T01:24:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.875+0000 7f054a2356c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] conn(0x7f051c0dced0 0x7f051c0fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.876+0000 7f0549a346c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f051c0b5760 0x7f051c0d5c10 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0534006b60 tx=0x7f0534006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.876+0000 7f054a2356c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] conn(0x7f051c0dced0 0x7f051c0fd2e0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.877+0000 7f803affd6c0 1 -- 10.20.193.40:0/965854678 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8040004030 con 0x7f804c119bb0 2026-02-13T01:24:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.877+0000 7f803affd6c0 1 -- 10.20.193.40:0/965854678 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f80400026b0 con 0x7f804c119bb0 2026-02-13T01:24:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.877+0000 7f803affd6c0 1 -- 10.20.193.40:0/965854678 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8040014800 con 0x7f804c119bb0 2026-02-13T01:24:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.877+0000 7f8053ca06c0 1 -- 10.20.193.40:0/965854678 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803c00b750 con 0x7f804c119bb0 2026-02-13T01:24:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.877+0000 7f8053ca06c0 1 -- 10.20.193.40:0/965854678 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f804c1684f0 con 0x7f804c119bb0 2026-02-13T01:24:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.878+0000 7f8038ff96c0 1 -- 10.20.193.40:0/965854678 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8014000fe0 con 0x7f804c119bb0 2026-02-13T01:24:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.879+0000 7f0532ffd6c0 1 -- 10.20.193.40:0/775151252 <== osd.11 v2:10.20.193.118:6824/1832833901 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f051c0fd990 con 0x7f051c0dced0 2026-02-13T01:24:06.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.880+0000 7f803affd6c0 1 -- 10.20.193.40:0/965854678 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8040004190 con 0x7f804c119bb0 2026-02-13T01:24:06.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.882+0000 7f803affd6c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80200b58b0 0x7f80200d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.882+0000 7f803affd6c0 1 -- 10.20.193.40:0/965854678 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f80400e8350 con 0x7f804c119bb0 2026-02-13T01:24:06.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.882+0000 7f803affd6c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] conn(0x7f80200dd020 0x7f80200fd430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.882+0000 7f803affd6c0 1 -- 10.20.193.40:0/965854678 --> [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80200fdae0 con 0x7f80200dd020 2026-02-13T01:24:06.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.882+0000 7f803affd6c0 1 -- 10.20.193.40:0/965854678 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f80400e8680 con 0x7f804c119bb0 2026-02-13T01:24:06.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.883+0000 7faa977fe6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7faa6c0b56b0 0x7faa6c0d5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.883+0000 7f80522126c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] conn(0x7f80200dd020 0x7f80200fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.883+0000 7f8051a116c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80200b58b0 0x7f80200d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.883+0000 7faa957fa6c0 1 -- 10.20.193.40:0/1340395483 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7faa840e3c60 con 0x7faa98113740 2026-02-13T01:24:06.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.884+0000 7f80522126c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] conn(0x7f80200dd020 0x7f80200fd430 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.884+0000 7f8051a116c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80200b58b0 0x7f80200d5d60 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f803c00ba80 tx=0x7f803c0023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.884+0000 7faa957fa6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] conn(0x7faa6c0dccb0 0x7faa6c0fd0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.884+0000 7f803affd6c0 1 -- 10.20.193.40:0/965854678 <== osd.10 v2:10.20.193.55:6824/461194356 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f80200fdae0 con 0x7f80200dd020 2026-02-13T01:24:06.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.884+0000 7faa977fe6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7faa6c0b56b0 0x7faa6c0d5b60 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa98061a90 tx=0x7faa880093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.884+0000 7faa957fa6c0 1 -- 10.20.193.40:0/1340395483 --> [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa6c0fd770 con 0x7faa6c0dccb0 2026-02-13T01:24:06.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.885+0000 7faa957fa6c0 1 -- 10.20.193.40:0/1340395483 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7faa840e6250 con 0x7faa98113740 2026-02-13T01:24:06.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.884+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/762453151 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe68114000 msgr2=0x7efe681143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.884+0000 7efe6c8a36c0 1 --2- 10.20.193.40:0/762453151 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe68114000 0x7efe681143d0 secure :-1 s=READY pgs=85 gs=2 cs=0 l=1 c_cookie=12963203088789830079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe5c006fd0 tx=0x7efe5c02fd20 comp rx=0 tx=0).stop 2026-02-13T01:24:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.887+0000 7f0518d976c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] conn(0x7f04e80ddbd0 0x7f04e80fe060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.886+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/762453151 shutdown_connections 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.886+0000 7efe6c8a36c0 1 --2- 10.20.193.40:0/762453151 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe68116990 0x7efe6817a5a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.886+0000 7efe6c8a36c0 1 --2- 10.20.193.40:0/762453151 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe681149f0 0x7efe681161e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.886+0000 7efe6c8a36c0 1 --2- 10.20.193.40:0/762453151 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe68114000 0x7efe681143d0 unknown :-1 s=CLOSED pgs=85 gs=2 cs=0 l=1 c_cookie=12963203088789830079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.886+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/762453151 >> 10.20.193.40:0/762453151 conn(0x7efe6805aaa0 msgr2=0x7efe6805b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.886+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/762453151 shutdown_connections 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.886+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/762453151 wait complete. 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.887+0000 7efe6c8a36c0 1 Processor -- start 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.887+0000 7efe6c8a36c0 1 -- start start 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.888+0000 7efe6c8a36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe68114000 0x7efe68185ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.888+0000 7f0518d976c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] conn(0x7f04e80ddbd0 0x7f04e80fe060 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.888+0000 7efe6c8a36c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe68116990 0x7efe68186530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.888+0000 7efe6c8a36c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe6815b510 0x7efe6815b9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7efe6c8a36c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efe6815bef0 con 0x7efe68114000 2026-02-13T01:24:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7efe6c8a36c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7efe6815c060 con 0x7efe6815b510 2026-02-13T01:24:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7efe6c8a36c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7efe6815c220 con 0x7efe68116990 2026-02-13T01:24:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7efe67fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe6815b510 0x7efe6815b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.887+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 --> [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0544179620 con 0x7f051c0dced0 2026-02-13T01:24:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7efe66ffd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe68116990 0x7efe68186530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7efe66ffd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe68116990 0x7efe68186530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:51972/0 (socket says 10.20.193.40:51972) 2026-02-13T01:24:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.888+0000 7f0532ffd6c0 1 -- 10.20.193.40:0/775151252 <== osd.11 v2:10.20.193.118:6824/1832833901 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0544179620 con 0x7f051c0dced0 2026-02-13T01:24:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 >> [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] conn(0x7f051c0dced0 msgr2=0x7f051c0fd2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7f054aa366c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.118:6824/1832833901,v1:10.20.193.118:6825/1832833901] conn(0x7f051c0dced0 0x7f051c0fd2e0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f051c0b5760 msgr2=0x7f051c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7f054aa366c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f051c0b5760 0x7f051c0d5c10 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0534006b60 tx=0x7f0534006af0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0544115270 msgr2=0x7f0544175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7f054aa366c0 1 --2- 10.20.193.40:0/775151252 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0544115270 0x7f0544175b10 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0538005b20 tx=0x7f05380028e0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7f054a2356c0 1 -- 10.20.193.40:0/775151252 reap_dead start 2026-02-13T01:24:06.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.889+0000 7efe66ffd6c0 1 -- 10.20.193.40:0/4288748481 learned_addr learned my addr 10.20.193.40:0/4288748481 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:06.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.890+0000 7faa9ccef6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] conn(0x7faa6c0dccb0 0x7faa6c0fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.894 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.890+0000 7efe677fe6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe68114000 0x7efe68185ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.894 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.890+0000 7efe66ffd6c0 1 -- 10.20.193.40:0/4288748481 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe6815b510 msgr2=0x7efe6815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.894 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.890+0000 7efe66ffd6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe6815b510 0x7efe6815b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.894 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.890+0000 7efe66ffd6c0 1 -- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe68114000 msgr2=0x7efe68185ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.894 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.890+0000 7efe66ffd6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe68114000 0x7efe68185ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.891+0000 7efe66ffd6c0 1 -- 10.20.193.40:0/4288748481 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c00a5b0 con 0x7efe68116990 2026-02-13T01:24:06.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.891+0000 7efe67fff6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efe6815b510 0x7efe6815b9b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:06.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.891+0000 7efe677fe6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efe68114000 0x7efe68185ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:06.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.892+0000 7efe66ffd6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe68116990 0x7efe68186530 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe5400b7f0 tx=0x7efe5400bcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.892+0000 7efe64ff96c0 1 -- 10.20.193.40:0/4288748481 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe54004280 con 0x7efe68116990 2026-02-13T01:24:06.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.893+0000 7efe64ff96c0 1 -- 10.20.193.40:0/4288748481 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efe540043e0 con 0x7efe68116990 2026-02-13T01:24:06.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.893+0000 7efe64ff96c0 1 -- 10.20.193.40:0/4288748481 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe5400ce80 con 0x7efe68116990 2026-02-13T01:24:06.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.893+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6815c500 con 0x7efe68116990 2026-02-13T01:24:06.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.893+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6815c960 con 0x7efe68116990 2026-02-13T01:24:06.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.897+0000 7f8038ff96c0 1 -- 10.20.193.40:0/965854678 --> [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8014002d20 con 0x7f80200dd020 2026-02-13T01:24:06.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.897+0000 7f803affd6c0 1 -- 10.20.193.40:0/965854678 <== osd.10 v2:10.20.193.55:6824/461194356 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8014002d20 con 0x7f80200dd020 2026-02-13T01:24:06.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.898+0000 7f8038ff96c0 1 -- 10.20.193.40:0/965854678 >> [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] conn(0x7f80200dd020 msgr2=0x7f80200fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.898+0000 7f8038ff96c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.55:6824/461194356,v1:10.20.193.55:6825/461194356] conn(0x7f80200dd020 0x7f80200fd430 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.898+0000 7f8038ff96c0 1 -- 10.20.193.40:0/965854678 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80200b58b0 msgr2=0x7f80200d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.898+0000 7f8038ff96c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80200b58b0 0x7f80200d5d60 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f803c00ba80 tx=0x7f803c0023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.898+0000 7f8038ff96c0 1 -- 10.20.193.40:0/965854678 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f804c119bb0 msgr2=0x7f804c121c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.898+0000 7f8038ff96c0 1 --2- 10.20.193.40:0/965854678 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f804c119bb0 0x7f804c121c90 secure :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8040009f40 tx=0x7f804000be00 comp rx=0 tx=0).stop 2026-02-13T01:24:06.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.898+0000 7f80522126c0 1 -- 10.20.193.40:0/965854678 reap_dead start 2026-02-13T01:24:06.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.898+0000 7f8038ff96c0 1 -- 10.20.193.40:0/965854678 shutdown_connections 2026-02-13T01:24:06.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.899+0000 7f8038ff96c0 1 -- 10.20.193.40:0/965854678 >> 10.20.193.40:0/965854678 conn(0x7f804c05bb70 msgr2=0x7f804c1179d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.899+0000 7f8038ff96c0 1 -- 10.20.193.40:0/965854678 shutdown_connections 2026-02-13T01:24:06.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.899+0000 7f8038ff96c0 1 -- 10.20.193.40:0/965854678 wait complete. 2026-02-13T01:24:06.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.900+0000 7f05117fa6c0 1 -- 10.20.193.40:0/1056154821 <== osd.0 v2:10.20.193.40:6802/3956883177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f04e80fe7b0 con 0x7f04e80ddbd0 2026-02-13T01:24:06.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.891+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 shutdown_connections 2026-02-13T01:24:06.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.891+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 >> 10.20.193.40:0/775151252 conn(0x7f05440ec980 msgr2=0x7f0544111850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.891+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 shutdown_connections 2026-02-13T01:24:06.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.891+0000 7f054aa366c0 1 -- 10.20.193.40:0/775151252 wait complete. 2026-02-13T01:24:06.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.896+0000 7efe64ff96c0 1 -- 10.20.193.40:0/4288748481 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7efe5400c4d0 con 0x7efe68116990 2026-02-13T01:24:06.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.903+0000 7efe64ff96c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe480b57b0 0x7efe480d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.903+0000 7efe64ff96c0 1 -- 10.20.193.40:0/4288748481 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7efe540e3a10 con 0x7efe68116990 2026-02-13T01:24:06.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.903+0000 7efe677fe6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe480b57b0 0x7efe480d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.904+0000 7efe677fe6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe480b57b0 0x7efe480d5c60 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe5c00a900 tx=0x7efe5c002470 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.908+0000 7efe6c8a36c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] conn(0x7efe2c001600 0x7efe2c021ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.908+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 --> [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe2c024c10 con 0x7efe2c001600 2026-02-13T01:24:06.912 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.911+0000 7efe67fff6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] conn(0x7efe2c001600 0x7efe2c021ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.912+0000 7efe67fff6c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] conn(0x7efe2c001600 0x7efe2c021ab0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.913+0000 7efe64ff96c0 1 -- 10.20.193.40:0/4288748481 <== osd.9 v2:10.20.193.40:6826/1636530405 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7efe2c024c10 con 0x7efe2c001600 2026-02-13T01:24:06.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.896+0000 7faa9ccef6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] conn(0x7faa6c0dccb0 0x7faa6c0fd0c0 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.916+0000 7faa957fa6c0 1 -- 10.20.193.40:0/1340395483 <== osd.2 v2:10.20.193.118:6800/2584237293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7faa6c0fd770 con 0x7faa6c0dccb0 2026-02-13T01:24:06.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.933+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 --> [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0514177250 con 0x7f04e80ddbd0 2026-02-13T01:24:06.936 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.935+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 --> [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa9817dbb0 con 0x7faa6c0dccb0 2026-02-13T01:24:06.936 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.935+0000 7f05117fa6c0 1 -- 10.20.193.40:0/1056154821 <== osd.0 v2:10.20.193.40:6802/3956883177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0514177250 con 0x7f04e80ddbd0 2026-02-13T01:24:06.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.935+0000 7faa957fa6c0 1 -- 10.20.193.40:0/1340395483 <== osd.2 v2:10.20.193.118:6800/2584237293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faa9817dbb0 con 0x7faa6c0dccb0 2026-02-13T01:24:06.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.936+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 >> [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] conn(0x7faa6c0dccb0 msgr2=0x7faa6c0fd0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.936+0000 7faa9e77d6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.118:6800/2584237293,v1:10.20.193.118:6801/2584237293] conn(0x7faa6c0dccb0 0x7faa6c0fd0c0 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.936+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7faa6c0b56b0 msgr2=0x7faa6c0d5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.936+0000 7faa9e77d6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7faa6c0b56b0 0x7faa6c0d5b60 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa98061a90 tx=0x7faa880093f0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.936+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faa98113740 msgr2=0x7faa9811a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.936+0000 7faa9e77d6c0 1 --2- 10.20.193.40:0/1340395483 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faa98113740 0x7faa9811a370 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa84004750 tx=0x7faa8400bed0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.936+0000 7faa9ccef6c0 1 -- 10.20.193.40:0/1340395483 reap_dead start 2026-02-13T01:24:06.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.936+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 shutdown_connections 2026-02-13T01:24:06.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.936+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 >> 10.20.193.40:0/1340395483 conn(0x7faa980610f0 msgr2=0x7faa98117d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.937+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 shutdown_connections 2026-02-13T01:24:06.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.937+0000 7faa9e77d6c0 1 -- 10.20.193.40:0/1340395483 wait complete. 2026-02-13T01:24:06.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.938+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 --> [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe2c023d00 con 0x7efe2c001600 2026-02-13T01:24:06.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.939+0000 7efe64ff96c0 1 -- 10.20.193.40:0/4288748481 <== osd.9 v2:10.20.193.40:6826/1636530405 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efe2c023d00 con 0x7efe2c001600 2026-02-13T01:24:06.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.940+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] conn(0x7efe2c001600 msgr2=0x7efe2c021ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.940+0000 7efe6c8a36c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6826/1636530405,v1:10.20.193.40:6827/1636530405] conn(0x7efe2c001600 0x7efe2c021ab0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.940+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe480b57b0 msgr2=0x7efe480d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.940+0000 7efe6c8a36c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efe480b57b0 0x7efe480d5c60 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe5c00a900 tx=0x7efe5c002470 comp rx=0 tx=0).stop 2026-02-13T01:24:06.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.940+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe68116990 msgr2=0x7efe68186530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.940+0000 7efe6c8a36c0 1 --2- 10.20.193.40:0/4288748481 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efe68116990 0x7efe68186530 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe5400b7f0 tx=0x7efe5400bcc0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.940+0000 7efe67fff6c0 1 -- 10.20.193.40:0/4288748481 reap_dead start 2026-02-13T01:24:06.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.947+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] conn(0x7f04e80ddbd0 msgr2=0x7f04e80fe060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.947+0000 7f05195986c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6802/3956883177,v1:10.20.193.40:6803/3956883177] conn(0x7f04e80ddbd0 0x7f04e80fe060 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.952+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 shutdown_connections 2026-02-13T01:24:06.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.952+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 >> 10.20.193.40:0/4288748481 conn(0x7efe6805aaa0 msgr2=0x7efe681179b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.958+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 shutdown_connections 2026-02-13T01:24:06.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.958+0000 7efe6c8a36c0 1 -- 10.20.193.40:0/4288748481 wait complete. 2026-02-13T01:24:06.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.948+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f04e80b57b0 msgr2=0x7f04e80d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.948+0000 7f05195986c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f04e80b57b0 0x7f04e80d5c60 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05000023e0 tx=0x7f0500005910 comp rx=0 tx=0).stop 2026-02-13T01:24:06.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.948+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0514112ff0 msgr2=0x7f0514119b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.948+0000 7f05195986c0 1 --2- 10.20.193.40:0/1056154821 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0514112ff0 0x7f0514119b50 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0504004750 tx=0x7f050400bb80 comp rx=0 tx=0).stop 2026-02-13T01:24:06.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.948+0000 7f0518d976c0 1 -- 10.20.193.40:0/1056154821 reap_dead start 2026-02-13T01:24:06.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.949+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 shutdown_connections 2026-02-13T01:24:06.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.949+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 >> 10.20.193.40:0/1056154821 conn(0x7f05140ea6a0 msgr2=0x7f051410aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.963+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 shutdown_connections 2026-02-13T01:24:06.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:06.963+0000 7f05195986c0 1 -- 10.20.193.40:0/1056154821 wait complete. 2026-02-13T01:24:06.991 INFO:teuthology.orchestra.run.trial040.stdout:51539607578 2026-02-13T01:24:06.991 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T01:24:07.063 INFO:teuthology.orchestra.run.trial040.stdout:124554051605 2026-02-13T01:24:07.063 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T01:24:07.139 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:07 trial040 ceph-mon[23046]: pgmap v183: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 7.8 KiB/s wr, 15 op/s 2026-02-13T01:24:07.156 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.170 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.278 INFO:teuthology.orchestra.run.trial040.stdout:171798691857 2026-02-13T01:24:07.279 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T01:24:07.324 INFO:teuthology.orchestra.run.trial040.stdout:296352743433 2026-02-13T01:24:07.325 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T01:24:07.370 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.374 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.376 INFO:teuthology.orchestra.run.trial040.stdout:266287972362 2026-02-13T01:24:07.376 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T01:24:07.403 INFO:teuthology.orchestra.run.trial040.stdout:249108103180 2026-02-13T01:24:07.404 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T01:24:07.405 INFO:teuthology.orchestra.run.trial040.stdout:219043332110 2026-02-13T01:24:07.411 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T01:24:07.412 INFO:teuthology.orchestra.run.trial040.stdout:94489280534 2026-02-13T01:24:07.412 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T01:24:07.417 INFO:teuthology.orchestra.run.trial040.stdout:34359738395 2026-02-13T01:24:07.417 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T01:24:07.443 INFO:teuthology.orchestra.run.trial040.stdout:68719476760 2026-02-13T01:24:07.444 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T01:24:07.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:07 trial055 ceph-mon[27509]: pgmap v183: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 7.8 KiB/s wr, 15 op/s 2026-02-13T01:24:07.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:07 trial118 ceph-mon[27812]: pgmap v183: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 7.8 KiB/s wr, 15 op/s 2026-02-13T01:24:07.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.582+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3648495358 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fee24114910 msgr2=0x7fee24116380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.582+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3648495358 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fee24114910 0x7fee24116380 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=822635709964573713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee180099a0 tx=0x7fee18030fb0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.582+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3648495358 shutdown_connections 2026-02-13T01:24:07.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.583+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3648495358 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fee241168c0 0x7fee24116d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.583+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3648495358 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fee24114910 0x7fee24116380 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=822635709964573713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.583+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3648495358 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fee24114000 0x7fee241143d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.583+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3648495358 >> 10.20.193.40:0/3648495358 conn(0x7fee240586e0 msgr2=0x7fee24058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:07.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.584+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3648495358 shutdown_connections 2026-02-13T01:24:07.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.584+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3648495358 wait complete. 2026-02-13T01:24:07.586 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.585+0000 7fee2becc6c0 1 Processor -- start 2026-02-13T01:24:07.586 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.585+0000 7fee2becc6c0 1 -- start start 2026-02-13T01:24:07.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.586+0000 7fee2becc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fee24114000 0x7fee24122580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.586+0000 7fee2becc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fee24114910 0x7fee24122ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.586+0000 7fee29c416c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fee24114000 0x7fee24122580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.587+0000 7fee29c416c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fee24114000 0x7fee24122580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33732/0 (socket says 10.20.193.40:33732) 2026-02-13T01:24:07.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.587+0000 7fee2becc6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fee241168c0 0x7fee24127e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.587+0000 7fee294406c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fee24114910 0x7fee24122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.587+0000 7fee294406c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fee24114910 0x7fee24122ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33692/0 (socket says 10.20.193.40:33692) 2026-02-13T01:24:07.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.588+0000 7fee2a4426c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fee241168c0 0x7fee24127e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.588+0000 7fee2a4426c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fee241168c0 0x7fee24127e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:52000/0 (socket says 10.20.193.40:52000) 2026-02-13T01:24:07.590 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.588+0000 7fee2becc6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fee24128440 con 0x7fee24114000 2026-02-13T01:24:07.590 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.588+0000 7fee2becc6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fee241285b0 con 0x7fee24114910 2026-02-13T01:24:07.590 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.588+0000 7fee2becc6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fee24128770 con 0x7fee241168c0 2026-02-13T01:24:07.592 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.589+0000 7fee29c416c0 1 -- 10.20.193.40:0/3720179826 learned_addr learned my addr 10.20.193.40:0/3720179826 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:07.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.591+0000 7fee2a4426c0 1 -- 10.20.193.40:0/3720179826 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fee24114910 msgr2=0x7fee24122ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.591+0000 7fee2a4426c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fee24114910 0x7fee24122ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.591+0000 7fee2a4426c0 1 -- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fee24114000 msgr2=0x7fee24122580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.592+0000 7fee2a4426c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fee24114000 0x7fee24122580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7fee2a4426c0 1 -- 10.20.193.40:0/3720179826 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee18009590 con 0x7fee241168c0 2026-02-13T01:24:07.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7fee29c416c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fee24114000 0x7fee24122580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:07.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7fee2a4426c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fee241168c0 0x7fee24127e80 secure :-1 s=READY pgs=96 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee2000c6c0 tx=0x7fee2000cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7fee12ffd6c0 1 -- 10.20.193.40:0/3720179826 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee200054a0 con 0x7fee241168c0 2026-02-13T01:24:07.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee24128a50 con 0x7fee241168c0 2026-02-13T01:24:07.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7fee12ffd6c0 1 -- 10.20.193.40:0/3720179826 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fee2000a030 con 0x7fee241168c0 2026-02-13T01:24:07.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7fee12ffd6c0 1 -- 10.20.193.40:0/3720179826 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee2000de00 con 0x7fee241168c0 2026-02-13T01:24:07.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.594+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee241691c0 con 0x7fee241168c0 2026-02-13T01:24:07.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.595+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee24114fe0 con 0x7fee241168c0 2026-02-13T01:24:07.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.597+0000 7fee12ffd6c0 1 -- 10.20.193.40:0/3720179826 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fee20003810 con 0x7fee241168c0 2026-02-13T01:24:07.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.600+0000 7fee12ffd6c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fedec0b58b0 0x7fedec0d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.600+0000 7fee12ffd6c0 1 -- 10.20.193.40:0/3720179826 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fee200e4990 con 0x7fee241168c0 2026-02-13T01:24:07.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.600+0000 7fee29c416c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fedec0b58b0 0x7fedec0d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.601+0000 7fee29c416c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fedec0b58b0 0x7fedec0d5d60 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee14005f90 tx=0x7fee14009410 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.601+0000 7fee12ffd6c0 1 -- 10.20.193.40:0/3720179826 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fee200aa490 con 0x7fee241168c0 2026-02-13T01:24:07.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.643+0000 7f89048026c0 1 -- 10.20.193.40:0/3271288271 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8900119760 msgr2=0x7f890017a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.643+0000 7f89048026c0 1 --2- 10.20.193.40:0/3271288271 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8900119760 0x7f890017a100 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=2552485011447468434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e8009970 tx=0x7f88e802ed30 comp rx=0 tx=0).stop 2026-02-13T01:24:07.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.644+0000 7f89048026c0 1 -- 10.20.193.40:0/3271288271 shutdown_connections 2026-02-13T01:24:07.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.644+0000 7f89048026c0 1 --2- 10.20.193.40:0/3271288271 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8900119760 0x7f890017a100 unknown :-1 s=CLOSED pgs=88 gs=2 cs=0 l=1 c_cookie=2552485011447468434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.644+0000 7f89048026c0 1 --2- 10.20.193.40:0/3271288271 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8900113f90 0x7f8900118f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.644+0000 7f89048026c0 1 --2- 10.20.193.40:0/3271288271 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f89001135a0 0x7f8900113970 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.644+0000 7f89048026c0 1 -- 10.20.193.40:0/3271288271 >> 10.20.193.40:0/3271288271 conn(0x7f8900061dc0 msgr2=0x7f89000621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:07.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.644+0000 7f89048026c0 1 -- 10.20.193.40:0/3271288271 shutdown_connections 2026-02-13T01:24:07.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.644+0000 7f89048026c0 1 -- 10.20.193.40:0/3271288271 wait complete. 2026-02-13T01:24:07.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.645+0000 7f89048026c0 1 Processor -- start 2026-02-13T01:24:07.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.646+0000 7f89048026c0 1 -- start start 2026-02-13T01:24:07.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f89048026c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f89001135a0 0x7f8900121090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f89048026c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8900119760 0x7f89001215d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f89048026c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8900126940 0x7f8900126de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f88fed726c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f89001135a0 0x7f8900121090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f88fed726c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f89001135a0 0x7f8900121090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33724/0 (socket says 10.20.193.40:33724) 2026-02-13T01:24:07.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f89048026c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8900127350 con 0x7f8900126940 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f89048026c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f89001274c0 con 0x7f89001135a0 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f89048026c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8900127680 con 0x7f8900119760 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f88fe5716c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8900119760 0x7f89001215d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.647+0000 7f88fed726c0 1 -- 10.20.193.40:0/3629525749 learned_addr learned my addr 10.20.193.40:0/3629525749 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.648+0000 7f88ff5736c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8900126940 0x7f8900126de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.648+0000 7f88fe5716c0 1 -- 10.20.193.40:0/3629525749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f89001135a0 msgr2=0x7f8900121090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.648+0000 7f88fe5716c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f89001135a0 0x7f8900121090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.648+0000 7f88fe5716c0 1 -- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8900126940 msgr2=0x7f8900126de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.648+0000 7f88fe5716c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8900126940 0x7f8900126de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.648+0000 7f88fe5716c0 1 -- 10.20.193.40:0/3629525749 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e8009590 con 0x7f8900119760 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.648+0000 7f88ff5736c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8900126940 0x7f8900126de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:07.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.648+0000 7f88fed726c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f89001135a0 0x7f8900121090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:07.652 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.648+0000 7f88fe5716c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8900119760 0x7f89001215d0 secure :-1 s=READY pgs=97 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ec004750 tx=0x7f88ec00bae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.652 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.649+0000 7f88f7fff6c0 1 -- 10.20.193.40:0/3629525749 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88ec0044a0 con 0x7f8900119760 2026-02-13T01:24:07.652 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.649+0000 7f88f7fff6c0 1 -- 10.20.193.40:0/3629525749 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f88ec009030 con 0x7f8900119760 2026-02-13T01:24:07.652 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.649+0000 7f88f7fff6c0 1 -- 10.20.193.40:0/3629525749 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88ec00ce30 con 0x7f8900119760 2026-02-13T01:24:07.652 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.649+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8900167b30 con 0x7f8900119760 2026-02-13T01:24:07.652 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.649+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8900167f90 con 0x7f8900119760 2026-02-13T01:24:07.654 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.652+0000 7f88f7fff6c0 1 -- 10.20.193.40:0/3629525749 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f88ec00c370 con 0x7f8900119760 2026-02-13T01:24:07.655 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.653+0000 7f88f7fff6c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88d40b55e0 0x7f88d40d5a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.655 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.653+0000 7f88f7fff6c0 1 -- 10.20.193.40:0/3629525749 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f88ec0e3c10 con 0x7f8900119760 2026-02-13T01:24:07.655 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.654+0000 7f88fed726c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88d40b55e0 0x7f88d40d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.656 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.655+0000 7f88fed726c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88d40b55e0 0x7f88d40d5a90 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88f0007fd0 tx=0x7f88f000a250 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.657 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.656+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8900114820 con 0x7f8900119760 2026-02-13T01:24:07.659 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.658+0000 7f88f7fff6c0 1 -- 10.20.193.40:0/3629525749 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88ec0a6560 con 0x7f8900119760 2026-02-13T01:24:07.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.590+0000 7f88b2c176c0 1 -- 10.20.193.40:0/862671286 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f88ac10cfb0 msgr2=0x7f88ac10d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.592+0000 7f88ab7fe6c0 1 -- 10.20.193.40:0/862671286 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8890004290 con 0x7f88ac10cfb0 2026-02-13T01:24:07.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.592+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/862671286 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f88ac10cfb0 0x7f88ac10d380 secure :-1 s=READY pgs=226 gs=2 cs=0 l=1 c_cookie=9793726776692139863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8890009c00 tx=0x7f889002efd0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7f88b2c176c0 1 -- 10.20.193.40:0/862671286 shutdown_connections 2026-02-13T01:24:07.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/862671286 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f88ac1131c0 0x7f88ac173b60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/862671286 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f88ac10d9a0 0x7f88ac1129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/862671286 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f88ac10cfb0 0x7f88ac10d380 unknown :-1 s=CLOSED pgs=226 gs=2 cs=0 l=1 c_cookie=9793726776692139863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7f88b2c176c0 1 -- 10.20.193.40:0/862671286 >> 10.20.193.40:0/862671286 conn(0x7f88ac0ea8b0 msgr2=0x7f88ac10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7f88b2c176c0 1 -- 10.20.193.40:0/862671286 shutdown_connections 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.593+0000 7f88b2c176c0 1 -- 10.20.193.40:0/862671286 wait complete. 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.595+0000 7f88b2c176c0 1 Processor -- start 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.595+0000 7f88b2c176c0 1 -- start start 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.595+0000 7f88b2c176c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f88ac10cfb0 0x7f88ac17d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.595+0000 7f88b2c176c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f88ac1131c0 0x7f88ac17dc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.595+0000 7f88b2c176c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f88ac154a60 0x7f88ac154ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.595+0000 7f88b2c176c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac155420 con 0x7f88ac154a60 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.595+0000 7f88b2c176c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac155590 con 0x7f88ac1131c0 2026-02-13T01:24:07.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.595+0000 7f88b2c176c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac155750 con 0x7f88ac10cfb0 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88b09886c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f88ac10cfb0 0x7f88ac17d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88abfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f88ac1131c0 0x7f88ac17dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88abfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f88ac1131c0 0x7f88ac17dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33698/0 (socket says 10.20.193.40:33698) 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88abfff6c0 1 -- 10.20.193.40:0/2959838084 learned_addr learned my addr 10.20.193.40:0/2959838084 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88b11896c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f88ac154a60 0x7f88ac154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88abfff6c0 1 -- 10.20.193.40:0/2959838084 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f88ac10cfb0 msgr2=0x7f88ac17d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88abfff6c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f88ac10cfb0 0x7f88ac17d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88abfff6c0 1 -- 10.20.193.40:0/2959838084 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f88ac154a60 msgr2=0x7f88ac154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88abfff6c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f88ac154a60 0x7f88ac154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88abfff6c0 1 -- 10.20.193.40:0/2959838084 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88980094c0 con 0x7f88ac1131c0 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.596+0000 7f88abfff6c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f88ac1131c0 0x7f88ac17dc50 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889800ba30 tx=0x7f889800bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.597+0000 7f88a9ffb6c0 1 -- 10.20.193.40:0/2959838084 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8898004250 con 0x7f88ac1131c0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.598+0000 7f88a9ffb6c0 1 -- 10.20.193.40:0/2959838084 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8898009070 con 0x7f88ac1131c0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.598+0000 7f88a9ffb6c0 1 -- 10.20.193.40:0/2959838084 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8898007440 con 0x7f88ac1131c0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.598+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8890009590 con 0x7f88ac1131c0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.598+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac155d30 con 0x7f88ac1131c0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.599+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8870005310 con 0x7f88ac1131c0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.602+0000 7f88a9ffb6c0 1 -- 10.20.193.40:0/2959838084 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f889800c720 con 0x7f88ac1131c0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.604+0000 7f88a9ffb6c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88800b58b0 0x7f88800d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.604+0000 7f88a9ffb6c0 1 -- 10.20.193.40:0/2959838084 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f88980e3bf0 con 0x7f88ac1131c0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.604+0000 7f88b09886c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88800b58b0 0x7f88800d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.604+0000 7f88a9ffb6c0 1 -- 10.20.193.40:0/2959838084 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88980a65d0 con 0x7f88ac1131c0 2026-02-13T01:24:07.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.605+0000 7f88b09886c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88800b58b0 0x7f88800d5d60 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8890009b20 tx=0x7f88900023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.696 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.717 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.724+0000 7f40d3e976c0 1 -- 10.20.193.40:0/3086132024 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f40cc114000 msgr2=0x7f40cc1143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.724+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/3086132024 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f40cc114000 0x7f40cc1143d0 secure :-1 s=READY pgs=89 gs=2 cs=0 l=1 c_cookie=9474020477137782927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40bc009970 tx=0x7f40bc02ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:07.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.725+0000 7f40d3e976c0 1 -- 10.20.193.40:0/3086132024 shutdown_connections 2026-02-13T01:24:07.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.725+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/3086132024 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f40cc116b30 0x7f40cc17a760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.725+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/3086132024 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f40cc1149f0 0x7f40cc116380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.725+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/3086132024 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f40cc114000 0x7f40cc1143d0 unknown :-1 s=CLOSED pgs=89 gs=2 cs=0 l=1 c_cookie=9474020477137782927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.725+0000 7f40d3e976c0 1 -- 10.20.193.40:0/3086132024 >> 10.20.193.40:0/3086132024 conn(0x7f40cc0586e0 msgr2=0x7f40cc058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:07.728 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.727+0000 7f40d3e976c0 1 -- 10.20.193.40:0/3086132024 shutdown_connections 2026-02-13T01:24:07.728 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.727+0000 7f40d3e976c0 1 -- 10.20.193.40:0/3086132024 wait complete. 2026-02-13T01:24:07.729 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.728+0000 7f40d3e976c0 1 Processor -- start 2026-02-13T01:24:07.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.728+0000 7f40d3e976c0 1 -- start start 2026-02-13T01:24:07.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.729+0000 7f40d3e976c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f40cc114000 0x7f40cc0f6730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.729+0000 7f40d3e976c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f40cc116b30 0x7f40cc17a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.729+0000 7f40d3e976c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f40cc0f6d10 0x7f40cc0f71b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.729+0000 7f40d3e976c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc109560 con 0x7f40cc114000 2026-02-13T01:24:07.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.729+0000 7f40d3e976c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc1096d0 con 0x7f40cc0f6d10 2026-02-13T01:24:07.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.729+0000 7f40d3e976c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc109890 con 0x7f40cc116b30 2026-02-13T01:24:07.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.729+0000 7f40d24096c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f40cc0f6d10 0x7f40cc0f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.729+0000 7f40d14076c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f40cc116b30 0x7f40cc17a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.737 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.730+0000 7f40d14076c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f40cc116b30 0x7f40cc17a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:52032/0 (socket says 10.20.193.40:52032) 2026-02-13T01:24:07.737 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.730+0000 7f40d14076c0 1 -- 10.20.193.40:0/662517453 learned_addr learned my addr 10.20.193.40:0/662517453 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:07.737 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.730+0000 7f40d24096c0 1 -- 10.20.193.40:0/662517453 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f40cc116b30 msgr2=0x7f40cc17a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.737 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.730+0000 7f40d24096c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f40cc116b30 0x7f40cc17a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.737 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.730+0000 7f40d24096c0 1 -- 10.20.193.40:0/662517453 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f40cc114000 msgr2=0x7f40cc0f6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.737 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.730+0000 7f40d24096c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f40cc114000 0x7f40cc0f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.737 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.730+0000 7f40d24096c0 1 -- 10.20.193.40:0/662517453 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c800a5b0 con 0x7f40cc0f6d10 2026-02-13T01:24:07.737 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.731+0000 7f40d24096c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f40cc0f6d10 0x7f40cc0f71b0 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40c8006fd0 tx=0x7f40c800cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.743+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fee241236d0 con 0x7fee241168c0 2026-02-13T01:24:07.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.743+0000 7fee12ffd6c0 1 -- 10.20.193.40:0/3720179826 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fee200aa670 con 0x7fee241168c0 2026-02-13T01:24:07.745 INFO:teuthology.orchestra.run.trial040.stdout:141733920788 2026-02-13T01:24:07.749 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fedec0b58b0 msgr2=0x7fedec0d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.749 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fedec0b58b0 0x7fedec0d5d60 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee14005f90 tx=0x7fee14009410 comp rx=0 tx=0).stop 2026-02-13T01:24:07.749 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fee241168c0 msgr2=0x7fee24127e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.749 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fee241168c0 0x7fee24127e80 secure :-1 s=READY pgs=96 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee2000c6c0 tx=0x7fee2000cb90 comp rx=0 tx=0).stop 2026-02-13T01:24:07.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 shutdown_connections 2026-02-13T01:24:07.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fedec0b58b0 0x7fedec0d5d60 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fee241168c0 0x7fee24127e80 unknown :-1 s=CLOSED pgs=96 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fee24114910 0x7fee24122ac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 --2- 10.20.193.40:0/3720179826 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fee24114000 0x7fee24122580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 >> 10.20.193.40:0/3720179826 conn(0x7fee240586e0 msgr2=0x7fee24119550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:07.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 shutdown_connections 2026-02-13T01:24:07.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.748+0000 7fee2becc6c0 1 -- 10.20.193.40:0/3720179826 wait complete. 2026-02-13T01:24:07.751 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.796+0000 7f40baffd6c0 1 -- 10.20.193.40:0/662517453 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40c8003c40 con 0x7f40cc0f6d10 2026-02-13T01:24:07.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.796+0000 7f40baffd6c0 1 -- 10.20.193.40:0/662517453 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f40c800a070 con 0x7f40cc0f6d10 2026-02-13T01:24:07.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.796+0000 7f40baffd6c0 1 -- 10.20.193.40:0/662517453 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40c8008440 con 0x7f40cc0f6d10 2026-02-13T01:24:07.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.796+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc009590 con 0x7f40cc0f6d10 2026-02-13T01:24:07.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.797+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40cc109e70 con 0x7f40cc0f6d10 2026-02-13T01:24:07.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.797+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40cc114fe0 con 0x7f40cc0f6d10 2026-02-13T01:24:07.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.802+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8900122190 con 0x7f8900119760 2026-02-13T01:24:07.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.802+0000 7f88f7fff6c0 1 -- 10.20.193.40:0/3629525749 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f88ec0a6560 con 0x7f8900119760 2026-02-13T01:24:07.804 INFO:teuthology.orchestra.run.trial040.stdout:124554051604 2026-02-13T01:24:07.808 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.803+0000 7f40baffd6c0 1 -- 10.20.193.40:0/662517453 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f40c8005860 con 0x7f40cc0f6d10 2026-02-13T01:24:07.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.806+0000 7f40baffd6c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40a00b58b0 0x7f40a00d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.806+0000 7f40baffd6c0 1 -- 10.20.193.40:0/662517453 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f40c80e4b20 con 0x7f40cc0f6d10 2026-02-13T01:24:07.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.806+0000 7f40baffd6c0 1 -- 10.20.193.40:0/662517453 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f40c811d5e0 con 0x7f40cc0f6d10 2026-02-13T01:24:07.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.807+0000 7f40d1c086c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40a00b58b0 0x7f40a00d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.806+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88d40b55e0 msgr2=0x7f88d40d5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.806+0000 7f89048026c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88d40b55e0 0x7f88d40d5a90 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88f0007fd0 tx=0x7f88f000a250 comp rx=0 tx=0).stop 2026-02-13T01:24:07.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.806+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8900119760 msgr2=0x7f89001215d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.806+0000 7f89048026c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8900119760 0x7f89001215d0 secure :-1 s=READY pgs=97 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ec004750 tx=0x7f88ec00bae0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.808+0000 7f40d1c086c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40a00b58b0 0x7f40a00d5d60 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40bc0098c0 tx=0x7f40bc005f20 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.819+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 shutdown_connections 2026-02-13T01:24:07.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.819+0000 7f89048026c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88d40b55e0 0x7f88d40d5a90 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.819+0000 7f89048026c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8900126940 0x7f8900126de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.819+0000 7f89048026c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8900119760 0x7f89001215d0 unknown :-1 s=CLOSED pgs=97 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.819+0000 7f89048026c0 1 --2- 10.20.193.40:0/3629525749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f89001135a0 0x7f8900121090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.819+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 >> 10.20.193.40:0/3629525749 conn(0x7f8900061dc0 msgr2=0x7f8900063160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:07.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.821+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 shutdown_connections 2026-02-13T01:24:07.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.821+0000 7f89048026c0 1 -- 10.20.193.40:0/3629525749 wait complete. 2026-02-13T01:24:07.827 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.827 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.852+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f88700055c0 con 0x7f88ac1131c0 2026-02-13T01:24:07.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.853+0000 7f88a9ffb6c0 1 -- 10.20.193.40:0/2959838084 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f88980a96f0 con 0x7f88ac1131c0 2026-02-13T01:24:07.856 INFO:teuthology.orchestra.run.trial040.stdout:188978561039 2026-02-13T01:24:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.857+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88800b58b0 msgr2=0x7f88800d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.857+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88800b58b0 0x7f88800d5d60 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8890009b20 tx=0x7f88900023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.857+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f88ac1131c0 msgr2=0x7f88ac17dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.857+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f88ac1131c0 0x7f88ac17dc50 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889800ba30 tx=0x7f889800bf00 comp rx=0 tx=0).stop 2026-02-13T01:24:07.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.858+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 shutdown_connections 2026-02-13T01:24:07.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.858+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f88800b58b0 0x7f88800d5d60 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.858+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f88ac154a60 0x7f88ac154ee0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.858+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f88ac1131c0 0x7f88ac17dc50 unknown :-1 s=CLOSED pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.858+0000 7f88b2c176c0 1 --2- 10.20.193.40:0/2959838084 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f88ac10cfb0 0x7f88ac17d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.858+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 >> 10.20.193.40:0/2959838084 conn(0x7f88ac0ea8b0 msgr2=0x7f88ac10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:07.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.861+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 shutdown_connections 2026-02-13T01:24:07.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.861+0000 7f88b2c176c0 1 -- 10.20.193.40:0/2959838084 wait complete. 2026-02-13T01:24:07.880 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:07.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.900+0000 7fc27e9336c0 1 -- 10.20.193.40:0/3006245255 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc27805f810 msgr2=0x7fc278063f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.900+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/3006245255 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc27805f810 0x7fc278063f70 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=9721919513393003438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc264009860 tx=0x7fc26402ed50 comp rx=0 tx=0).stop 2026-02-13T01:24:07.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.900+0000 7fc27e9336c0 1 -- 10.20.193.40:0/3006245255 shutdown_connections 2026-02-13T01:24:07.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.900+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/3006245255 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc278064720 0x7fc2780650e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.900+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/3006245255 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc27805f810 0x7fc278063f70 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=9721919513393003438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.900+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/3006245255 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc27805ee20 0x7fc27805f1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.900+0000 7fc27e9336c0 1 -- 10.20.193.40:0/3006245255 >> 10.20.193.40:0/3006245255 conn(0x7fc2780586e0 msgr2=0x7fc278058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:07.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.900+0000 7fc27e9336c0 1 -- 10.20.193.40:0/3006245255 shutdown_connections 2026-02-13T01:24:07.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.901+0000 7fc27e9336c0 1 -- 10.20.193.40:0/3006245255 wait complete. 2026-02-13T01:24:07.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.903+0000 7fc27e9336c0 1 Processor -- start 2026-02-13T01:24:07.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.903+0000 7fc27e9336c0 1 -- start start 2026-02-13T01:24:07.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.904+0000 7fc27e9336c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc27805ee20 0x7fc2780f8c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.904+0000 7fc27e9336c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc278064720 0x7fc2780f91a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.904+0000 7fc27e9336c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2780fe560 0x7fc2780fea00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.904+0000 7fc27e9336c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc2780fef40 con 0x7fc278064720 2026-02-13T01:24:07.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.904+0000 7fc27e9336c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc2780ff0b0 con 0x7fc27805ee20 2026-02-13T01:24:07.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.904+0000 7fc27e9336c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc2780ff270 con 0x7fc2780fe560 2026-02-13T01:24:07.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.904+0000 7fc277fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc27805ee20 0x7fc2780f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.904+0000 7fc277fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc27805ee20 0x7fc2780f8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33762/0 (socket says 10.20.193.40:33762) 2026-02-13T01:24:07.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.904+0000 7fc2777fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc278064720 0x7fc2780f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.905+0000 7fc27cea56c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2780fe560 0x7fc2780fea00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.905+0000 7fc277fff6c0 1 -- 10.20.193.40:0/1712937800 learned_addr learned my addr 10.20.193.40:0/1712937800 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.905+0000 7fc277fff6c0 1 -- 10.20.193.40:0/1712937800 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2780fe560 msgr2=0x7fc2780fea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.905+0000 7fc277fff6c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2780fe560 0x7fc2780fea00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.905+0000 7fc277fff6c0 1 -- 10.20.193.40:0/1712937800 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc278064720 msgr2=0x7fc2780f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.905+0000 7fc277fff6c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc278064720 0x7fc2780f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.905+0000 7fc277fff6c0 1 -- 10.20.193.40:0/1712937800 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc264009480 con 0x7fc27805ee20 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.905+0000 7fc27cea56c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2780fe560 0x7fc2780fea00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.906+0000 7fc277fff6c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc27805ee20 0x7fc2780f8c60 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc25c0092e0 tx=0x7fc25c00bc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.906+0000 7fc2757fa6c0 1 -- 10.20.193.40:0/1712937800 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc25c004250 con 0x7fc27805ee20 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.906+0000 7fc2757fa6c0 1 -- 10.20.193.40:0/1712937800 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc25c0043b0 con 0x7fc27805ee20 2026-02-13T01:24:07.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.906+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2780ff6d0 con 0x7fc27805ee20 2026-02-13T01:24:07.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.906+0000 7fc2757fa6c0 1 -- 10.20.193.40:0/1712937800 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc25c0072a0 con 0x7fc27805ee20 2026-02-13T01:24:07.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.906+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2780ffbb0 con 0x7fc27805ee20 2026-02-13T01:24:07.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.908+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27805b020 con 0x7fc27805ee20 2026-02-13T01:24:07.911 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.910+0000 7fc2757fa6c0 1 -- 10.20.193.40:0/1712937800 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc25c00c5c0 con 0x7fc27805ee20 2026-02-13T01:24:07.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.917+0000 7fc2757fa6c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc24c0b5760 0x7fc24c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:07.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.917+0000 7fc2757fa6c0 1 -- 10.20.193.40:0/1712937800 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fc25c0e3b90 con 0x7fc27805ee20 2026-02-13T01:24:07.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.917+0000 7fc2757fa6c0 1 -- 10.20.193.40:0/1712937800 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc25c0e7180 con 0x7fc27805ee20 2026-02-13T01:24:07.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.917+0000 7fc2777fe6c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc24c0b5760 0x7fc24c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:07.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.918+0000 7fc2777fe6c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc24c0b5760 0x7fc24c0d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2780ff5f0 tx=0x7fc264005ae0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:07.940 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920788 got 141733920788 for osd.5 2026-02-13T01:24:07.940 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:07.963 INFO:teuthology.orchestra.run.trial040.stdout:51539607577 2026-02-13T01:24:07.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.961+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f40cc114a50 con 0x7f40cc0f6d10 2026-02-13T01:24:07.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.962+0000 7f40baffd6c0 1 -- 10.20.193.40:0/662517453 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40c80a7500 con 0x7f40cc0f6d10 2026-02-13T01:24:07.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.964+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40a00b58b0 msgr2=0x7f40a00d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.964+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40a00b58b0 0x7f40a00d5d60 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40bc0098c0 tx=0x7f40bc005f20 comp rx=0 tx=0).stop 2026-02-13T01:24:07.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.964+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f40cc0f6d10 msgr2=0x7f40cc0f71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:07.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.964+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f40cc0f6d10 0x7f40cc0f71b0 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40c8006fd0 tx=0x7f40c800cd80 comp rx=0 tx=0).stop 2026-02-13T01:24:07.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.965+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 shutdown_connections 2026-02-13T01:24:07.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.965+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40a00b58b0 0x7f40a00d5d60 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.965+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f40cc0f6d10 0x7f40cc0f71b0 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.965+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f40cc116b30 0x7f40cc17a6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.965+0000 7f40d3e976c0 1 --2- 10.20.193.40:0/662517453 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f40cc114000 0x7f40cc0f6730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:07.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.965+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 >> 10.20.193.40:0/662517453 conn(0x7f40cc0586e0 msgr2=0x7f40cc0592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:07.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.966+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 shutdown_connections 2026-02-13T01:24:07.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:07.966+0000 7f40d3e976c0 1 -- 10.20.193.40:0/662517453 wait complete. 2026-02-13T01:24:08.042 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.041+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc2780f9db0 con 0x7fc27805ee20 2026-02-13T01:24:08.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.044+0000 7f6189bc86c0 1 -- 10.20.193.40:0/4141169370 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 msgr2=0x7f618410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.044+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/4141169370 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 0x7f618410f5d0 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=10566947983682532516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61700099a0 tx=0x7f617002ed70 comp rx=0 tx=0).stop 2026-02-13T01:24:08.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.045+0000 7f6189bc86c0 1 -- 10.20.193.40:0/4141169370 shutdown_connections 2026-02-13T01:24:08.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.045+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/4141169370 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6184115410 0x7f6184175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.045+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/4141169370 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f618410fbf0 0x7f6184114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.045+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/4141169370 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 0x7f618410f5d0 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=10566947983682532516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.045+0000 7f6189bc86c0 1 -- 10.20.193.40:0/4141169370 >> 10.20.193.40:0/4141169370 conn(0x7f61840ecb00 msgr2=0x7f618410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.045+0000 7f6189bc86c0 1 -- 10.20.193.40:0/4141169370 shutdown_connections 2026-02-13T01:24:08.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.045+0000 7f6189bc86c0 1 -- 10.20.193.40:0/4141169370 wait complete. 2026-02-13T01:24:08.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.046+0000 7f6189bc86c0 1 Processor -- start 2026-02-13T01:24:08.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.047+0000 7f6189bc86c0 1 -- start start 2026-02-13T01:24:08.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.047+0000 7f6189bc86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 0x7f61840f03a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.047+0000 7f6189bc86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6184115410 0x7f6184175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.047+0000 7f6189bc86c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61840f09d0 0x7f61840ef1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.048+0000 7f6189bc86c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f61840f1090 con 0x7f618410f200 2026-02-13T01:24:08.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.048+0000 7f6189bc86c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f61840ef700 con 0x7f6184115410 2026-02-13T01:24:08.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.048+0000 7f6189bc86c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f61840ef8c0 con 0x7f61840f09d0 2026-02-13T01:24:08.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.048+0000 7f61837fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 0x7f61840f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.048+0000 7f61837fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 0x7f61840f03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33806/0 (socket says 10.20.193.40:33806) 2026-02-13T01:24:08.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.048+0000 7f61837fe6c0 1 -- 10.20.193.40:0/1656556492 learned_addr learned my addr 10.20.193.40:0/1656556492 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:08.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.048+0000 7fc2757fa6c0 1 -- 10.20.193.40:0/1712937800 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc25c0a64e0 con 0x7fc27805ee20 2026-02-13T01:24:08.054 INFO:teuthology.orchestra.run.trial040.stdout:171798691856 2026-02-13T01:24:08.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.050+0000 7f61837fe6c0 1 -- 10.20.193.40:0/1656556492 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61840f09d0 msgr2=0x7f61840ef1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.050+0000 7f61837fe6c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61840f09d0 0x7f61840ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.050+0000 7f61837fe6c0 1 -- 10.20.193.40:0/1656556492 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6184115410 msgr2=0x7f6184175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.050+0000 7f61837fe6c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6184115410 0x7f6184175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.050+0000 7f61837fe6c0 1 -- 10.20.193.40:0/1656556492 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6170009590 con 0x7f618410f200 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.050+0000 7f61837fe6c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 0x7f61840f03a0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6170005b40 tx=0x7f617002f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.050+0000 7f6180ff96c0 1 -- 10.20.193.40:0/1656556492 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61700026b0 con 0x7f618410f200 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.050+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61840efb40 con 0x7f618410f200 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.051+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61840f3590 con 0x7f618410f200 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.051+0000 7f6180ff96c0 1 -- 10.20.193.40:0/1656556492 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6170031560 con 0x7f618410f200 2026-02-13T01:24:08.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.051+0000 7f6180ff96c0 1 -- 10.20.193.40:0/1656556492 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6170007c20 con 0x7f618410f200 2026-02-13T01:24:08.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.051+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc24c0b5760 msgr2=0x7fc24c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.051+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc24c0b5760 0x7fc24c0d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2780ff5f0 tx=0x7fc264005ae0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.051+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc27805ee20 msgr2=0x7fc2780f8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.051+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc27805ee20 0x7fc2780f8c60 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc25c0092e0 tx=0x7fc25c00bc90 comp rx=0 tx=0).stop 2026-02-13T01:24:08.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.052+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61841104d0 con 0x7f618410f200 2026-02-13T01:24:08.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.053+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 shutdown_connections 2026-02-13T01:24:08.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.053+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc24c0b5760 0x7fc24c0d5c10 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.053+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2780fe560 0x7fc2780fea00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.053+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc278064720 0x7fc2780f91a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.053+0000 7fc27e9336c0 1 --2- 10.20.193.40:0/1712937800 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc27805ee20 0x7fc2780f8c60 unknown :-1 s=CLOSED pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.053+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 >> 10.20.193.40:0/1712937800 conn(0x7fc2780586e0 msgr2=0x7fc278060180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.053+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 shutdown_connections 2026-02-13T01:24:08.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.053+0000 7fc27e9336c0 1 -- 10.20.193.40:0/1712937800 wait complete. 2026-02-13T01:24:08.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.054+0000 7f6180ff96c0 1 -- 10.20.193.40:0/1656556492 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f61700316d0 con 0x7f618410f200 2026-02-13T01:24:08.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.055+0000 7f6180ff96c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61580b57e0 0x7f61580d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.055+0000 7f6180ff96c0 1 -- 10.20.193.40:0/1656556492 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f6170108060 con 0x7f618410f200 2026-02-13T01:24:08.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.056+0000 7f6182ffd6c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61580b57e0 0x7f61580d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.056+0000 7f6182ffd6c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61580b57e0 0x7f61580d5c90 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61841139d0 tx=0x7f6174006d50 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.057+0000 7f6180ff96c0 1 -- 10.20.193.40:0/1656556492 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f61700ca9b0 con 0x7f618410f200 2026-02-13T01:24:08.070 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.068+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/3719594615 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 msgr2=0x7fa4bc113dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.070 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.068+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/3719594615 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 0x7fa4bc113dc0 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=15545297892320089339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4ac00aa40 tx=0x7fa4ac02fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.071 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.068+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/3719594615 shutdown_connections 2026-02-13T01:24:08.071 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.068+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/3719594615 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4bc117a50 0x7fa4bc117eb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.071 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.068+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/3719594615 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4bc114300 0x7fa4bc114730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.071 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.068+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/3719594615 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 0x7fa4bc113dc0 unknown :-1 s=CLOSED pgs=92 gs=2 cs=0 l=1 c_cookie=15545297892320089339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.071 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.068+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/3719594615 >> 10.20.193.40:0/3719594615 conn(0x7fa4bc0586e0 msgr2=0x7fa4bc058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.071 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.068+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/3719594615 shutdown_connections 2026-02-13T01:24:08.071 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.068+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/3719594615 wait complete. 2026-02-13T01:24:08.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.069+0000 7fa4c0c596c0 1 Processor -- start 2026-02-13T01:24:08.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.069+0000 7fa4c0c596c0 1 -- start start 2026-02-13T01:24:08.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4c0c596c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4bc114300 0x7fa4bc0fd060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4c0c596c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 0x7fa4bc0fd5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4c0c596c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4bc117a50 0x7fa4bc102960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4c0c596c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc102fb0 con 0x7fa4bc117a50 2026-02-13T01:24:08.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4c0c596c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc103120 con 0x7fa4bc117500 2026-02-13T01:24:08.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4c0c596c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1032e0 con 0x7fa4bc114300 2026-02-13T01:24:08.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4b9d746c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 0x7fa4bc0fd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4b9d746c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 0x7fa4bc0fd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33810/0 (socket says 10.20.193.40:33810) 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4b9d746c0 1 -- 10.20.193.40:0/1029856456 learned_addr learned my addr 10.20.193.40:0/1029856456 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4bad766c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4bc117a50 0x7fa4bc102960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4ba5756c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4bc114300 0x7fa4bc0fd060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4b9d746c0 1 -- 10.20.193.40:0/1029856456 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4bc114300 msgr2=0x7fa4bc0fd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4b9d746c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4bc114300 0x7fa4bc0fd060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4b9d746c0 1 -- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4bc117a50 msgr2=0x7fa4bc102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.070+0000 7fa4b9d746c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4bc117a50 0x7fa4bc102960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.074+0000 7fa4b9d746c0 1 -- 10.20.193.40:0/1029856456 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a80094c0 con 0x7fa4bc117500 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.074+0000 7fa4bad766c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4bc117a50 0x7fa4bc102960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.074+0000 7fa4b9d746c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 0x7fa4bc0fd5a0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4a800ba30 tx=0x7fa4a800bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.074+0000 7fa4a77fe6c0 1 -- 10.20.193.40:0/1029856456 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4a802eea0 con 0x7fa4bc117500 2026-02-13T01:24:08.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.075+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ac00a660 con 0x7fa4bc117500 2026-02-13T01:24:08.078 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.075+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4bc15bf80 con 0x7fa4bc117500 2026-02-13T01:24:08.078 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.075+0000 7fa4a77fe6c0 1 -- 10.20.193.40:0/1029856456 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa4a8009020 con 0x7fa4bc117500 2026-02-13T01:24:08.078 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.075+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa488005310 con 0x7fa4bc117500 2026-02-13T01:24:08.078 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.076+0000 7fa4a77fe6c0 1 -- 10.20.193.40:0/1029856456 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4a802eea0 con 0x7fa4bc117500 2026-02-13T01:24:08.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.084+0000 7fa4a77fe6c0 1 -- 10.20.193.40:0/1029856456 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa4a80026b0 con 0x7fa4bc117500 2026-02-13T01:24:08.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.085+0000 7fa4a77fe6c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa48c0b5840 0x7fa48c0d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.085+0000 7fa4a77fe6c0 1 -- 10.20.193.40:0/1029856456 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fa4a8105fd0 con 0x7fa4bc117500 2026-02-13T01:24:08.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.085+0000 7fa4a77fe6c0 1 -- 10.20.193.40:0/1029856456 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa4a81063d0 con 0x7fa4bc117500 2026-02-13T01:24:08.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.087+0000 7fa4ba5756c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa48c0b5840 0x7fa48c0d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.087+0000 7fa4ba5756c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa48c0b5840 0x7fa48c0d5cf0 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4ac00a990 tx=0x7fa4ac002470 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.117+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/2084310056 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4d01149c0 msgr2=0x7fa4d0114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.117+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/2084310056 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4d01149c0 0x7fa4d0114ee0 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=571594504733833255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4cc006fd0 tx=0x7fa4cc02fd50 comp rx=0 tx=0).stop 2026-02-13T01:24:08.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.117+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/2084310056 shutdown_connections 2026-02-13T01:24:08.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.117+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/2084310056 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4d01149c0 0x7fa4d0114ee0 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=571594504733833255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.117+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/2084310056 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4d0113dc0 0x7fa4d0114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.117+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/2084310056 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4d011b510 0x7fa4d011b8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.117+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/2084310056 >> 10.20.193.40:0/2084310056 conn(0x7fa4d0058a50 msgr2=0x7fa4d0058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.118+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/2084310056 shutdown_connections 2026-02-13T01:24:08.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.118+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/2084310056 wait complete. 2026-02-13T01:24:08.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.118+0000 7fa4d7ee06c0 1 Processor -- start 2026-02-13T01:24:08.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.118+0000 7fa4d7ee06c0 1 -- start start 2026-02-13T01:24:08.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.120+0000 7fa4d7ee06c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4d0113dc0 0x7fa4d010be00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.120+0000 7fa4d7ee06c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4d01149c0 0x7fa4d010c340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.120+0000 7fa4d7ee06c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4d011b510 0x7fa4d0111700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.120+0000 7fa4d54546c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4d01149c0 0x7fa4d010c340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.120+0000 7fa4d54546c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4d01149c0 0x7fa4d010c340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33832/0 (socket says 10.20.193.40:33832) 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.120+0000 7fa4d5c556c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4d0113dc0 0x7fa4d010be00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d64566c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4d011b510 0x7fa4d0111700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d54546c0 1 -- 10.20.193.40:0/3403942212 learned_addr learned my addr 10.20.193.40:0/3403942212 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d0111d50 con 0x7fa4d011b510 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d0111ec0 con 0x7fa4d01149c0 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d0112080 con 0x7fa4d0113dc0 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d64566c0 1 -- 10.20.193.40:0/3403942212 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4d0113dc0 msgr2=0x7fa4d010be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d64566c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4d0113dc0 0x7fa4d010be00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.139 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d64566c0 1 -- 10.20.193.40:0/3403942212 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4d01149c0 msgr2=0x7fa4d010c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d64566c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4d01149c0 0x7fa4d010c340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.121+0000 7fa4d64566c0 1 -- 10.20.193.40:0/3403942212 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b80094c0 con 0x7fa4d011b510 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.122+0000 7fa4d5c556c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4d0113dc0 0x7fa4d010be00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.122+0000 7fa4d64566c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4d011b510 0x7fa4d0111700 secure :-1 s=READY pgs=230 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4cc030b50 tx=0x7fa4cc005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.122+0000 7fa4c6ffd6c0 1 -- 10.20.193.40:0/3403942212 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4cc003a30 con 0x7fa4d011b510 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.122+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc00a5b0 con 0x7fa4d011b510 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.122+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d0112870 con 0x7fa4d011b510 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.122+0000 7fa4c6ffd6c0 1 -- 10.20.193.40:0/3403942212 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa4cc006e30 con 0x7fa4d011b510 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.122+0000 7fa4c6ffd6c0 1 -- 10.20.193.40:0/3403942212 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4cc036480 con 0x7fa4d011b510 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.125+0000 7fa4c6ffd6c0 1 -- 10.20.193.40:0/3403942212 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa4cc008430 con 0x7fa4d011b510 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.127+0000 7fa4c6ffd6c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa4a80b5760 0x7fa4a80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.127+0000 7fa4c6ffd6c0 1 -- 10.20.193.40:0/3403942212 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fa4cc108d50 con 0x7fa4d011b510 2026-02-13T01:24:08.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.129+0000 7fa4d5c556c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa4a80b5760 0x7fa4a80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.129+0000 7fa4d5c556c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa4a80b5760 0x7fa4a80d5c10 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4b8004750 tx=0x7fa4b8009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.130+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa498005310 con 0x7fa4d011b510 2026-02-13T01:24:08.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.133+0000 7fa4c6ffd6c0 1 -- 10.20.193.40:0/3403942212 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa4cc0cb6e0 con 0x7fa4d011b510 2026-02-13T01:24:08.167 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607578 got 51539607577 for osd.1 2026-02-13T01:24:08.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.180+0000 7f66b53846c0 1 -- 10.20.193.40:0/4132807896 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 msgr2=0x7f66b01595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.180+0000 7f66b53846c0 1 --2- 10.20.193.40:0/4132807896 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 0x7f66b01595e0 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=162685604089841094 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66980098a0 tx=0x7f669802ec50 comp rx=0 tx=0).stop 2026-02-13T01:24:08.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.180+0000 7f66adffb6c0 1 -- 10.20.193.40:0/4132807896 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66980044a0 con 0x7f66b00675f0 2026-02-13T01:24:08.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.181+0000 7f66b53846c0 1 -- 10.20.193.40:0/4132807896 shutdown_connections 2026-02-13T01:24:08.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.181+0000 7f66b53846c0 1 --2- 10.20.193.40:0/4132807896 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f66b0159b20 0x7f66b0179f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.181+0000 7f66b53846c0 1 --2- 10.20.193.40:0/4132807896 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 0x7f66b01595e0 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=162685604089841094 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.181+0000 7f66b53846c0 1 --2- 10.20.193.40:0/4132807896 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f66b0066ce0 0x7f66b00670b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.181+0000 7f66b53846c0 1 -- 10.20.193.40:0/4132807896 >> 10.20.193.40:0/4132807896 conn(0x7f66b0064810 msgr2=0x7f66b0064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.181+0000 7f66b53846c0 1 -- 10.20.193.40:0/4132807896 shutdown_connections 2026-02-13T01:24:08.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.181+0000 7f66b53846c0 1 -- 10.20.193.40:0/4132807896 wait complete. 2026-02-13T01:24:08.190 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561040 got 188978561039 for osd.7 2026-02-13T01:24:08.191 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.190+0000 7f66b53846c0 1 Processor -- start 2026-02-13T01:24:08.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.195+0000 7f66b53846c0 1 -- start start 2026-02-13T01:24:08.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.195+0000 7f66b53846c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f66b0066ce0 0x7f66b00f86f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.195+0000 7f66b53846c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 0x7f66b00f8c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.195+0000 7f66b53846c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f66b0159b20 0x7f66b00fdff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.195+0000 7f66aeffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f66b0066ce0 0x7f66b00f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.195+0000 7f66aeffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f66b0066ce0 0x7f66b00f86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33854/0 (socket says 10.20.193.40:33854) 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.195+0000 7f66ae7fc6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 0x7f66b00f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66ae7fc6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 0x7f66b00f8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:52128/0 (socket says 10.20.193.40:52128) 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66aeffd6c0 1 -- 10.20.193.40:0/1107240068 learned_addr learned my addr 10.20.193.40:0/1107240068 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f66b00fe640 con 0x7f66b0159b20 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66af7fe6c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f66b0159b20 0x7f66b00fdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f66b00fe7b0 con 0x7f66b0066ce0 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f66b00fe970 con 0x7f66b00675f0 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66af7fe6c0 1 -- 10.20.193.40:0/1107240068 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 msgr2=0x7f66b00f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66af7fe6c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 0x7f66b00f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66af7fe6c0 1 -- 10.20.193.40:0/1107240068 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f66b0066ce0 msgr2=0x7f66b00f86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66af7fe6c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f66b0066ce0 0x7f66b00f86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66af7fe6c0 1 -- 10.20.193.40:0/1107240068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a4009590 con 0x7f66b0159b20 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66ae7fc6c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 0x7f66b00f8c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.196+0000 7f66aeffd6c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f66b0066ce0 0x7f66b00f86f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.197+0000 7f66af7fe6c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f66b0159b20 0x7f66b00fdff0 secure :-1 s=READY pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a0005830 tx=0x7f66a000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.197+0000 7f668ffff6c0 1 -- 10.20.193.40:0/1107240068 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66a0003a30 con 0x7f66b0159b20 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.197+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66980094c0 con 0x7f66b0159b20 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.197+0000 7f668ffff6c0 1 -- 10.20.193.40:0/1107240068 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f66a000a070 con 0x7f66b0159b20 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.197+0000 7f668ffff6c0 1 -- 10.20.193.40:0/1107240068 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66a0003a30 con 0x7f66b0159b20 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.198+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b013f180 con 0x7f66b0159b20 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.200+0000 7f668ffff6c0 1 -- 10.20.193.40:0/1107240068 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f66a00081c0 con 0x7f66b0159b20 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.202+0000 7f668ffff6c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66800b5840 0x7f66800d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.202+0000 7f668ffff6c0 1 -- 10.20.193.40:0/1107240068 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f66a00e4830 con 0x7f66b0159b20 2026-02-13T01:24:08.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.202+0000 7f66aeffd6c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66800b5840 0x7f66800d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.203+0000 7f66aeffd6c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66800b5840 0x7f66800d5cf0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a4005b40 tx=0x7f66a4009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.209 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.206+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f618410f5d0 con 0x7f618410f200 2026-02-13T01:24:08.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.209+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b00681f0 con 0x7f66b0159b20 2026-02-13T01:24:08.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.209+0000 7f6180ff96c0 1 -- 10.20.193.40:0/1656556492 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f61700cdb60 con 0x7f618410f200 2026-02-13T01:24:08.211 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051605 got 124554051604 for osd.4 2026-02-13T01:24:08.212 INFO:teuthology.orchestra.run.trial040.stdout:296352743432 2026-02-13T01:24:08.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.212+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa488005890 con 0x7fa4bc117500 2026-02-13T01:24:08.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.211+0000 7f668ffff6c0 1 -- 10.20.193.40:0/1107240068 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f66a00a7180 con 0x7f66b0159b20 2026-02-13T01:24:08.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.213+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61580b57e0 msgr2=0x7f61580d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.213+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61580b57e0 0x7f61580d5c90 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61841139d0 tx=0x7f6174006d50 comp rx=0 tx=0).stop 2026-02-13T01:24:08.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.213+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 msgr2=0x7f61840f03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.213+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 0x7f61840f03a0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6170005b40 tx=0x7f617002f7c0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.213+0000 7fa4a77fe6c0 1 -- 10.20.193.40:0/1029856456 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa4a80c89b0 con 0x7fa4bc117500 2026-02-13T01:24:08.215 INFO:teuthology.orchestra.run.trial040.stdout:266287972361 2026-02-13T01:24:08.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.214+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 shutdown_connections 2026-02-13T01:24:08.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.214+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61580b57e0 0x7f61580d5c90 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.214+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61840f09d0 0x7f61840ef1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.214+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6184115410 0x7f6184175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.214+0000 7f6189bc86c0 1 --2- 10.20.193.40:0/1656556492 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f618410f200 0x7f61840f03a0 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.214+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 >> 10.20.193.40:0/1656556492 conn(0x7f61840ecb00 msgr2=0x7f618410d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.214+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 shutdown_connections 2026-02-13T01:24:08.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.214+0000 7f6189bc86c0 1 -- 10.20.193.40:0/1656556492 wait complete. 2026-02-13T01:24:08.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.252+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa48c0b5840 msgr2=0x7fa48c0d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.252+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa48c0b5840 0x7fa48c0d5cf0 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4ac00a990 tx=0x7fa4ac002470 comp rx=0 tx=0).stop 2026-02-13T01:24:08.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.252+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 msgr2=0x7fa4bc0fd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.252+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 0x7fa4bc0fd5a0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4a800ba30 tx=0x7fa4a800bf00 comp rx=0 tx=0).stop 2026-02-13T01:24:08.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.255+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 shutdown_connections 2026-02-13T01:24:08.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.255+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa48c0b5840 0x7fa48c0d5cf0 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.255+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4bc117a50 0x7fa4bc102960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.255+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4bc117500 0x7fa4bc0fd5a0 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.255+0000 7fa4c0c596c0 1 --2- 10.20.193.40:0/1029856456 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4bc114300 0x7fa4bc0fd060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.255+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 >> 10.20.193.40:0/1029856456 conn(0x7fa4bc0586e0 msgr2=0x7fa4bc115a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.259 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691857 got 171798691856 for osd.6 2026-02-13T01:24:08.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.261+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/1183063247 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa124114000 msgr2=0x7fa1241143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.261+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/1183063247 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa124114000 0x7fa1241143d0 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=9515516658458645975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa11401ad80 tx=0x7fa114040130 comp rx=0 tx=0).stop 2026-02-13T01:24:08.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.263+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 shutdown_connections 2026-02-13T01:24:08.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.263+0000 7fa4c0c596c0 1 -- 10.20.193.40:0/1029856456 wait complete. 2026-02-13T01:24:08.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.263+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/1183063247 shutdown_connections 2026-02-13T01:24:08.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.263+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/1183063247 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa124119900 0x7fa12411a2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.263+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/1183063247 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1241149f0 0x7fa124119150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.263+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/1183063247 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa124114000 0x7fa1241143d0 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=9515516658458645975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.263+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/1183063247 >> 10.20.193.40:0/1183063247 conn(0x7fa1240586e0 msgr2=0x7fa124058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.263+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/1183063247 shutdown_connections 2026-02-13T01:24:08.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.263+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/1183063247 wait complete. 2026-02-13T01:24:08.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.265+0000 7fa12a36c6c0 1 Processor -- start 2026-02-13T01:24:08.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.265+0000 7fa12a36c6c0 1 -- start start 2026-02-13T01:24:08.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa12a36c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa124114000 0x7fa1241ac6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa12a36c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa124119900 0x7fa1241acbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa12a36c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1241b1fb0 0x7fa1241b2450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa12a36c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1241b2a50 con 0x7fa124119900 2026-02-13T01:24:08.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa12a36c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa1241b2bc0 con 0x7fa1241b1fb0 2026-02-13T01:24:08.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa12a36c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa1241b2d80 con 0x7fa124114000 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa1288e26c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1241b1fb0 0x7fa1241b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa1288e26c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1241b1fb0 0x7fa1241b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33866/0 (socket says 10.20.193.40:33866) 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa1288e26c0 1 -- 10.20.193.40:0/2991241240 learned_addr learned my addr 10.20.193.40:0/2991241240 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.266+0000 7fa123fff6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa124114000 0x7fa1241ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.267+0000 7fa1288e26c0 1 -- 10.20.193.40:0/2991241240 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa124114000 msgr2=0x7fa1241ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.267+0000 7fa1288e26c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa124114000 0x7fa1241ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.267+0000 7fa1288e26c0 1 -- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa124119900 msgr2=0x7fa1241acbf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.267+0000 7fa1237fe6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa124119900 0x7fa1241acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.267+0000 7fa1288e26c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa124119900 0x7fa1241acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.267+0000 7fa1288e26c0 1 -- 10.20.193.40:0/2991241240 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11800a5b0 con 0x7fa1241b1fb0 2026-02-13T01:24:08.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.267+0000 7fa123fff6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa124114000 0x7fa1241ac6b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:08.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.268+0000 7fa1237fe6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa124119900 0x7fa1241acbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:08.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.268+0000 7fa1288e26c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1241b1fb0 0x7fa1241b2450 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa11800a820 tx=0x7fa11800ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.272+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa4980055c0 con 0x7fa4d011b510 2026-02-13T01:24:08.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.273+0000 7fc0db5776c0 1 -- 10.20.193.40:0/3620024400 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc0dc112ff0 msgr2=0x7fc0dc173990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.273+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/3620024400 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc0dc112ff0 0x7fc0dc173990 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=13775212352327157993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0cc00aa40 tx=0x7fc0cc02fe30 comp rx=0 tx=0).stop 2026-02-13T01:24:08.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.273+0000 7fc0db5776c0 1 -- 10.20.193.40:0/3620024400 shutdown_connections 2026-02-13T01:24:08.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.273+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/3620024400 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc0dc112ff0 0x7fc0dc173990 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=13775212352327157993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.273+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/3620024400 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0dc10d7d0 0x7fc0dc112810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.273+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/3620024400 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc0dc10cde0 0x7fc0dc10d1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.273+0000 7fc0db5776c0 1 -- 10.20.193.40:0/3620024400 >> 10.20.193.40:0/3620024400 conn(0x7fc0dc0ea6a0 msgr2=0x7fc0dc10aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.273+0000 7fc0db5776c0 1 -- 10.20.193.40:0/3620024400 shutdown_connections 2026-02-13T01:24:08.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.273+0000 7fc0db5776c0 1 -- 10.20.193.40:0/3620024400 wait complete. 2026-02-13T01:24:08.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.274+0000 7fa4c6ffd6c0 1 -- 10.20.193.40:0/3403942212 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa4cc036650 con 0x7fa4d011b510 2026-02-13T01:24:08.276 INFO:teuthology.orchestra.run.trial040.stdout:94489280533 2026-02-13T01:24:08.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.274+0000 7fc0db5776c0 1 Processor -- start 2026-02-13T01:24:08.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.274+0000 7fc0db5776c0 1 -- start start 2026-02-13T01:24:08.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0db5776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc0dc10cde0 0x7fc0dc0f5700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0db5776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc0dc112ff0 0x7fc0dc0f5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0da5756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc0dc10cde0 0x7fc0dc0f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0da5756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc0dc10cde0 0x7fc0dc0f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33878/0 (socket says 10.20.193.40:33878) 2026-02-13T01:24:08.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0da5756c0 1 -- 10.20.193.40:0/1775205731 learned_addr learned my addr 10.20.193.40:0/1775205731 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:08.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0dc0ee950 0x7fc0dc0eedf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0d9d746c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc0dc112ff0 0x7fc0dc0f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc0ef440 con 0x7fc0dc0ee950 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc0ef5b0 con 0x7fc0dc10cde0 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.275+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc0ef770 con 0x7fc0dc112ff0 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0da5756c0 1 -- 10.20.193.40:0/1775205731 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc0dc112ff0 msgr2=0x7fc0dc0f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0da5756c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc0dc112ff0 0x7fc0dc0f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0dad766c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0dc0ee950 0x7fc0dc0eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0da5756c0 1 -- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0dc0ee950 msgr2=0x7fc0dc0eedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0da5756c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0dc0ee950 0x7fc0dc0eedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0da5756c0 1 -- 10.20.193.40:0/1775205731 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc00a660 con 0x7fc0dc10cde0 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0dad766c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0dc0ee950 0x7fc0dc0eedf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:08.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0da5756c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc0dc10cde0 0x7fc0dc0f5700 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0d0009490 tx=0x7fc0d000bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0cb7fe6c0 1 -- 10.20.193.40:0/1775205731 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0d0004a80 con 0x7fc0dc10cde0 2026-02-13T01:24:08.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.276+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0dc0f44b0 con 0x7fc0dc10cde0 2026-02-13T01:24:08.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.277+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0dc0f49b0 con 0x7fc0dc10cde0 2026-02-13T01:24:08.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.277+0000 7fc0cb7fe6c0 1 -- 10.20.193.40:0/1775205731 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc0d0009030 con 0x7fc0dc10cde0 2026-02-13T01:24:08.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.277+0000 7fc0cb7fe6c0 1 -- 10.20.193.40:0/1775205731 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0d0004a80 con 0x7fc0dc10cde0 2026-02-13T01:24:08.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.277+0000 7fa1217fa6c0 1 -- 10.20.193.40:0/2991241240 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa118003c40 con 0x7fa1241b1fb0 2026-02-13T01:24:08.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.277+0000 7fa1217fa6c0 1 -- 10.20.193.40:0/2991241240 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa11800a070 con 0x7fa1241b1fb0 2026-02-13T01:24:08.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.277+0000 7fa1217fa6c0 1 -- 10.20.193.40:0/2991241240 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa118008440 con 0x7fa1241b1fb0 2026-02-13T01:24:08.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.277+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11401a9a0 con 0x7fa1241b1fb0 2026-02-13T01:24:08.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.277+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa124213490 con 0x7fa1241b1fb0 2026-02-13T01:24:08.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.279+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0dc10e0b0 con 0x7fc0dc10cde0 2026-02-13T01:24:08.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.279+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e8005310 con 0x7fa1241b1fb0 2026-02-13T01:24:08.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.279+0000 7fa1217fa6c0 1 -- 10.20.193.40:0/2991241240 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa1180085d0 con 0x7fa1241b1fb0 2026-02-13T01:24:08.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.280+0000 7fc0cb7fe6c0 1 -- 10.20.193.40:0/1775205731 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc0d0004060 con 0x7fc0dc10cde0 2026-02-13T01:24:08.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.281+0000 7fa1217fa6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0f40b5830 0x7fa0f40d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.281+0000 7fa1217fa6c0 1 -- 10.20.193.40:0/2991241240 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fa1180e4ef0 con 0x7fa1241b1fb0 2026-02-13T01:24:08.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.281+0000 7fa123fff6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0f40b5830 0x7fa0f40d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.282+0000 7fa1217fa6c0 1 -- 10.20.193.40:0/2991241240 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa1180a8a20 con 0x7fa1241b1fb0 2026-02-13T01:24:08.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.282+0000 7fc0cb7fe6c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc0bc0b57c0 0x7fc0bc0d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.282+0000 7fa123fff6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0f40b5830 0x7fa0f40d5ce0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1140023e0 tx=0x7fa114005c90 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.282+0000 7fc0cb7fe6c0 1 -- 10.20.193.40:0/1775205731 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fc0d00e3800 con 0x7fc0dc10cde0 2026-02-13T01:24:08.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.283+0000 7fc0d9d746c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc0bc0b57c0 0x7fc0bc0d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.284+0000 7fc0d9d746c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc0bc0b57c0 0x7fc0bc0d5c70 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0dc1102e0 tx=0x7fc0c4009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.284+0000 7fc0cb7fe6c0 1 -- 10.20.193.40:0/1775205731 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc0d00a6190 con 0x7fc0dc10cde0 2026-02-13T01:24:08.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa4a80b5760 msgr2=0x7fa4a80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa4a80b5760 0x7fa4a80d5c10 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4b8004750 tx=0x7fa4b8009260 comp rx=0 tx=0).stop 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4d011b510 msgr2=0x7fa4d0111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4d011b510 0x7fa4d0111700 secure :-1 s=READY pgs=230 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4cc030b50 tx=0x7fa4cc005600 comp rx=0 tx=0).stop 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 shutdown_connections 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa4a80b5760 0x7fa4a80d5c10 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa4d011b510 0x7fa4d0111700 unknown :-1 s=CLOSED pgs=230 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa4d01149c0 0x7fa4d010c340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 --2- 10.20.193.40:0/3403942212 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa4d0113dc0 0x7fa4d010be00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 >> 10.20.193.40:0/3403942212 conn(0x7fa4d0058a50 msgr2=0x7fa4d011a460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 shutdown_connections 2026-02-13T01:24:08.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.287+0000 7fa4d7ee06c0 1 -- 10.20.193.40:0/3403942212 wait complete. 2026-02-13T01:24:08.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.321+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f66b00f9840 con 0x7f66b0159b20 2026-02-13T01:24:08.324 INFO:teuthology.orchestra.run.trial040.stdout:34359738394 2026-02-13T01:24:08.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.322+0000 7f668ffff6c0 1 -- 10.20.193.40:0/1107240068 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f66a00aa330 con 0x7f66b0159b20 2026-02-13T01:24:08.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66800b5840 msgr2=0x7f66800d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66800b5840 0x7f66800d5cf0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a4005b40 tx=0x7f66a4009310 comp rx=0 tx=0).stop 2026-02-13T01:24:08.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f66b0159b20 msgr2=0x7f66b00fdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f66b0159b20 0x7f66b00fdff0 secure :-1 s=READY pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a0005830 tx=0x7f66a000ceb0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 shutdown_connections 2026-02-13T01:24:08.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66800b5840 0x7f66800d5cf0 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f66b0159b20 0x7f66b00fdff0 unknown :-1 s=CLOSED pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f66b00675f0 0x7f66b00f8c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 --2- 10.20.193.40:0/1107240068 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f66b0066ce0 0x7f66b00f86f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.333+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 >> 10.20.193.40:0/1107240068 conn(0x7f66b0064810 msgr2=0x7f66b006e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.334+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 shutdown_connections 2026-02-13T01:24:08.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.334+0000 7f66b53846c0 1 -- 10.20.193.40:0/1107240068 wait complete. 2026-02-13T01:24:08.337 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743433 got 296352743432 for osd.11 2026-02-13T01:24:08.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.392+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa0e80055c0 con 0x7fa1241b1fb0 2026-02-13T01:24:08.405 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.397+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc0a80051b0 con 0x7fc0dc10cde0 2026-02-13T01:24:08.405 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.404+0000 7fc0cb7fe6c0 1 -- 10.20.193.40:0/1775205731 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc0d00a9340 con 0x7fc0dc10cde0 2026-02-13T01:24:08.407 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:08 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3720179826' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:24:08.408 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:08 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3629525749' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:24:08.408 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:08 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2959838084' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:24:08.408 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:08 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/662517453' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:24:08.408 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:08 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1712937800' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:24:08.408 INFO:teuthology.orchestra.run.trial040.stdout:219043332109 2026-02-13T01:24:08.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.404+0000 7fa1217fa6c0 1 -- 10.20.193.40:0/2991241240 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa1180abbd0 con 0x7fa1241b1fb0 2026-02-13T01:24:08.409 INFO:teuthology.orchestra.run.trial040.stdout:249108103179 2026-02-13T01:24:08.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.406+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc0bc0b57c0 msgr2=0x7fc0bc0d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.406+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc0bc0b57c0 0x7fc0bc0d5c70 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0dc1102e0 tx=0x7fc0c4009390 comp rx=0 tx=0).stop 2026-02-13T01:24:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.406+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc0dc10cde0 msgr2=0x7fc0dc0f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.406+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc0dc10cde0 0x7fc0dc0f5700 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0d0009490 tx=0x7fc0d000bca0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0f40b5830 msgr2=0x7fa0f40d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0f40b5830 0x7fa0f40d5ce0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1140023e0 tx=0x7fa114005c90 comp rx=0 tx=0).stop 2026-02-13T01:24:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1241b1fb0 msgr2=0x7fa1241b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1241b1fb0 0x7fa1241b2450 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa11800a820 tx=0x7fa11800ce50 comp rx=0 tx=0).stop 2026-02-13T01:24:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 shutdown_connections 2026-02-13T01:24:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc0bc0b57c0 0x7fc0bc0d5c70 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0dc0ee950 0x7fc0dc0eedf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc0dc112ff0 0x7fc0dc0f5c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fc0db5776c0 1 --2- 10.20.193.40:0/1775205731 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc0dc10cde0 0x7fc0dc0f5700 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 >> 10.20.193.40:0/1775205731 conn(0x7fc0dc0ea6a0 msgr2=0x7fc0dc10b260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.413+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 shutdown_connections 2026-02-13T01:24:08.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.413+0000 7fc0db5776c0 1 -- 10.20.193.40:0/1775205731 wait complete. 2026-02-13T01:24:08.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 shutdown_connections 2026-02-13T01:24:08.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa0f40b5830 0x7fa0f40d5ce0 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1241b1fb0 0x7fa1241b2450 unknown :-1 s=CLOSED pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa124119900 0x7fa1241acbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.422 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 --2- 10.20.193.40:0/2991241240 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa124114000 0x7fa1241ac6b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.422 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.407+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 >> 10.20.193.40:0/2991241240 conn(0x7fa1240586e0 msgr2=0x7fa124117100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.422 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.412+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 shutdown_connections 2026-02-13T01:24:08.422 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.412+0000 7fa12a36c6c0 1 -- 10.20.193.40:0/2991241240 wait complete. 2026-02-13T01:24:08.422 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.419+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/3576150829 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40bd050 msgr2=0x7efbf411d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.419+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/3576150829 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40bd050 0x7efbf411d9f0 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=7044332256040939367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efbec00aa70 tx=0x7efbec02fe10 comp rx=0 tx=0).stop 2026-02-13T01:24:08.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.420+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/3576150829 shutdown_connections 2026-02-13T01:24:08.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.420+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/3576150829 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40bd050 0x7efbf411d9f0 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=7044332256040939367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.420+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/3576150829 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efbf40b7830 0x7efbf40bc870 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.420+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/3576150829 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efbf40b6e40 0x7efbf40b7210 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.420+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/3576150829 >> 10.20.193.40:0/3576150829 conn(0x7efbf40946c0 msgr2=0x7efbf40b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.420+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/3576150829 shutdown_connections 2026-02-13T01:24:08.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.420+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/3576150829 wait complete. 2026-02-13T01:24:08.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.421+0000 7efbfbfff6c0 1 Processor -- start 2026-02-13T01:24:08.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.422+0000 7efbfbfff6c0 1 -- start start 2026-02-13T01:24:08.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.422+0000 7efbfbfff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40b6e40 0x7efbf40b4970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.422+0000 7efbfbfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efbf40bd050 0x7efbf40b1be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.422+0000 7efbfaffd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40b6e40 0x7efbf40b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.422+0000 7efbfbfff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efbf40b2120 0x7efbf40b25c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.422+0000 7efbfbfff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efbf4098bb0 con 0x7efbf40b6e40 2026-02-13T01:24:08.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.423+0000 7efbfaffd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40b6e40 0x7efbf40b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33908/0 (socket says 10.20.193.40:33908) 2026-02-13T01:24:08.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.423+0000 7efbfaffd6c0 1 -- 10.20.193.40:0/2309281345 learned_addr learned my addr 10.20.193.40:0/2309281345 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:08.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.423+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7efbf4098d20 con 0x7efbf40bd050 2026-02-13T01:24:08.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.423+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7efbf4098ee0 con 0x7efbf40b2120 2026-02-13T01:24:08.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.423+0000 7efbfb7fe6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efbf40b2120 0x7efbf40b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.425+0000 7efbfb7fe6c0 1 -- 10.20.193.40:0/2309281345 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efbf40bd050 msgr2=0x7efbf40b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbfa7fc6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efbf40bd050 0x7efbf40b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbfb7fe6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efbf40bd050 0x7efbf40b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbfb7fe6c0 1 -- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40b6e40 msgr2=0x7efbf40b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbfb7fe6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40b6e40 0x7efbf40b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbfb7fe6c0 1 -- 10.20.193.40:0/2309281345 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbec00a660 con 0x7efbf40b2120 2026-02-13T01:24:08.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbfaffd6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40b6e40 0x7efbf40b4970 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:08.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbfb7fe6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efbf40b2120 0x7efbf40b25c0 secure :-1 s=READY pgs=102 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efbec030320 tx=0x7efbec0308a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbdbfff6c0 1 -- 10.20.193.40:0/2309281345 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efbec0088d0 con 0x7efbf40b2120 2026-02-13T01:24:08.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbdbfff6c0 1 -- 10.20.193.40:0/2309281345 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efbec006030 con 0x7efbf40b2120 2026-02-13T01:24:08.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.426+0000 7efbdbfff6c0 1 -- 10.20.193.40:0/2309281345 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efbec0088d0 con 0x7efbf40b2120 2026-02-13T01:24:08.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.427+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf4099160 con 0x7efbf40b2120 2026-02-13T01:24:08.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.427+0000 7efbfa7fc6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efbf40bd050 0x7efbf40b1be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:08.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.427+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf4099610 con 0x7efbf40b2120 2026-02-13T01:24:08.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.429+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbf40b8110 con 0x7efbf40b2120 2026-02-13T01:24:08.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.432+0000 7efbdbfff6c0 1 -- 10.20.193.40:0/2309281345 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7efbec008a30 con 0x7efbf40b2120 2026-02-13T01:24:08.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.433+0000 7efbdbfff6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbd00b5840 0x7efbd00d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:08.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.433+0000 7efbdbfff6c0 1 -- 10.20.193.40:0/2309281345 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7efbec108b60 con 0x7efbf40b2120 2026-02-13T01:24:08.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.434+0000 7efbfaffd6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbd00b5840 0x7efbd00d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:08.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.434+0000 7efbfaffd6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbd00b5840 0x7efbd00d5cf0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efbe4006f40 tx=0x7efbe4009210 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:08.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.436+0000 7efbdbfff6c0 1 -- 10.20.193.40:0/2309281345 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efbec0cb4b0 con 0x7efbf40b2120 2026-02-13T01:24:08.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:08 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3720179826' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:24:08.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:08 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3629525749' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:24:08.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:08 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2959838084' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:24:08.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:08 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/662517453' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:24:08.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:08 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1712937800' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:24:08.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:08 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3720179826' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:24:08.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:08 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3629525749' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:24:08.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:08 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2959838084' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:24:08.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:08 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/662517453' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:24:08.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:08 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1712937800' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:24:08.506 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280534 got 94489280533 for osd.3 2026-02-13T01:24:08.507 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972362 got 266287972361 for osd.10 2026-02-13T01:24:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.541+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efbf40b7830 con 0x7efbf40b2120 2026-02-13T01:24:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.541+0000 7efbdbfff6c0 1 -- 10.20.193.40:0/2309281345 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efbec0cb4b0 con 0x7efbf40b2120 2026-02-13T01:24:08.543 INFO:teuthology.orchestra.run.trial040.stdout:68719476759 2026-02-13T01:24:08.545 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbd00b5840 msgr2=0x7efbd00d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.545 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbd00b5840 0x7efbd00d5cf0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efbe4006f40 tx=0x7efbe4009210 comp rx=0 tx=0).stop 2026-02-13T01:24:08.545 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efbf40b2120 msgr2=0x7efbf40b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.545 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efbf40b2120 0x7efbf40b25c0 secure :-1 s=READY pgs=102 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efbec030320 tx=0x7efbec0308a0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 shutdown_connections 2026-02-13T01:24:08.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbd00b5840 0x7efbd00d5cf0 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efbf40b2120 0x7efbf40b25c0 unknown :-1 s=CLOSED pgs=102 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efbf40bd050 0x7efbf40b1be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 --2- 10.20.193.40:0/2309281345 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efbf40b6e40 0x7efbf40b4970 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 >> 10.20.193.40:0/2309281345 conn(0x7efbf40946c0 msgr2=0x7efbf40b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 shutdown_connections 2026-02-13T01:24:08.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:08.544+0000 7efbfbfff6c0 1 -- 10.20.193.40:0/2309281345 wait complete. 2026-02-13T01:24:08.556 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738395 got 34359738394 for osd.0 2026-02-13T01:24:08.560 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103180 got 249108103179 for osd.9 2026-02-13T01:24:08.615 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332110 got 219043332109 for osd.8 2026-02-13T01:24:08.662 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476760 got 68719476759 for osd.2 2026-02-13T01:24:09.168 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T01:24:09.191 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T01:24:09.212 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T01:24:09.260 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T01:24:09.338 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T01:24:09.361 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.401 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.402 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.413 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:09 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1656556492' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:24:09.413 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:09 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1029856456' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:24:09.413 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:09 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3403942212' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:24:09.413 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:09 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1107240068' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:24:09.413 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:09 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2991241240' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:24:09.414 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:09 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1775205731' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:24:09.414 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:09 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2309281345' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:24:09.414 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:09 trial040 ceph-mon[23046]: pgmap v184: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 16 op/s 2026-02-13T01:24:09.459 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:09 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1656556492' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:24:09.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:09 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1029856456' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:24:09.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:09 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3403942212' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:24:09.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:09 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1107240068' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:24:09.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:09 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2991241240' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:24:09.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:09 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1775205731' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:24:09.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:09 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2309281345' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:24:09.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:09 trial055 ceph-mon[27509]: pgmap v184: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 16 op/s 2026-02-13T01:24:09.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:09 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1656556492' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:24:09.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:09 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1029856456' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:24:09.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:09 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3403942212' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:24:09.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:09 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1107240068' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:24:09.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:09 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2991241240' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:24:09.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:09 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1775205731' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:24:09.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:09 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2309281345' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:24:09.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:09 trial118 ceph-mon[27812]: pgmap v184: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 16 op/s 2026-02-13T01:24:09.507 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T01:24:09.508 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T01:24:09.543 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.557 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T01:24:09.561 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T01:24:09.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.589+0000 7fa9675776c0 1 -- 10.20.193.40:0/1926975367 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 msgr2=0x7fa96000ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.589+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1926975367 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 0x7fa96000ef20 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=14249134447611722606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa95c009970 tx=0x7fa95c02ed70 comp rx=0 tx=0).stop 2026-02-13T01:24:09.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.590+0000 7fa9675776c0 1 -- 10.20.193.40:0/1926975367 shutdown_connections 2026-02-13T01:24:09.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.590+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1926975367 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa9600bf320 0x7fa960121ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.590+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1926975367 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa96000f540 0x7fa9600beb90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.590+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1926975367 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 0x7fa96000ef20 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=14249134447611722606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.590+0000 7fa9675776c0 1 -- 10.20.193.40:0/1926975367 >> 10.20.193.40:0/1926975367 conn(0x7fa96000c400 msgr2=0x7fa96000c800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.590+0000 7fa9675776c0 1 -- 10.20.193.40:0/1926975367 shutdown_connections 2026-02-13T01:24:09.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.590+0000 7fa9675776c0 1 -- 10.20.193.40:0/1926975367 wait complete. 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.591+0000 7fa9675776c0 1 Processor -- start 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.591+0000 7fa9675776c0 1 -- start start 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.591+0000 7fa9675776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 0x7fa9600be390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.591+0000 7fa9675776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa9600bf320 0x7fa960121de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.591+0000 7fa9675776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa9600be9f0 0x7fa9600b75e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9675776c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa9600b7b20 con 0x7fa9600be9f0 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9675776c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa9600b7c90 con 0x7fa96000eb50 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9665756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 0x7fa9600be390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa966d766c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa9600be9f0 0x7fa9600b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9675776c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa9600b7e50 con 0x7fa9600bf320 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9665756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 0x7fa9600be390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33908/0 (socket says 10.20.193.40:33908) 2026-02-13T01:24:09.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9665756c0 1 -- 10.20.193.40:0/1144000527 learned_addr learned my addr 10.20.193.40:0/1144000527 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:09.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa965d746c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa9600bf320 0x7fa960121de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9665756c0 1 -- 10.20.193.40:0/1144000527 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa9600bf320 msgr2=0x7fa960121de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9665756c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa9600bf320 0x7fa960121de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9665756c0 1 -- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa9600be9f0 msgr2=0x7fa9600b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9665756c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa9600be9f0 0x7fa9600b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa9665756c0 1 -- 10.20.193.40:0/1144000527 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95c009590 con 0x7fa96000eb50 2026-02-13T01:24:09.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.592+0000 7fa966d766c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa9600be9f0 0x7fa9600b75e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:09.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.593+0000 7fa9665756c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 0x7fa9600be390 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa95c005ae0 tx=0x7fa95c02f840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.593+0000 7fa94f7fe6c0 1 -- 10.20.193.40:0/1144000527 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa95c005ed0 con 0x7fa96000eb50 2026-02-13T01:24:09.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.593+0000 7fa94f7fe6c0 1 -- 10.20.193.40:0/1144000527 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa95c02fa30 con 0x7fa96000eb50 2026-02-13T01:24:09.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.593+0000 7fa94f7fe6c0 1 -- 10.20.193.40:0/1144000527 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa95c0073f0 con 0x7fa96000eb50 2026-02-13T01:24:09.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.593+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9600b80d0 con 0x7fa96000eb50 2026-02-13T01:24:09.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.593+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9600bd020 con 0x7fa96000eb50 2026-02-13T01:24:09.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.596+0000 7fa94f7fe6c0 1 -- 10.20.193.40:0/1144000527 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa95c007580 con 0x7fa96000eb50 2026-02-13T01:24:09.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.597+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa930005310 con 0x7fa96000eb50 2026-02-13T01:24:09.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.597+0000 7fa94f7fe6c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa9440b58a0 0x7fa9440d5d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.598+0000 7fa94f7fe6c0 1 -- 10.20.193.40:0/1144000527 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fa95c109030 con 0x7fa96000eb50 2026-02-13T01:24:09.600 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.598+0000 7fa965d746c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa9440b58a0 0x7fa9440d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.600 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.599+0000 7fa965d746c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa9440b58a0 0x7fa9440d5d50 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9600bfec0 tx=0x7fa950009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.600+0000 7fa94f7fe6c0 1 -- 10.20.193.40:0/1144000527 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa95c0cb980 con 0x7fa96000eb50 2026-02-13T01:24:09.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.609+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/1001732602 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47a410fbf0 msgr2=0x7f47a4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.609+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/1001732602 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47a410fbf0 0x7f47a4114c30 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=1455639920758580146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47940099a0 tx=0x7f479402ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:09.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.609+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/1001732602 shutdown_connections 2026-02-13T01:24:09.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.609+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/1001732602 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47a4115410 0x7f47a4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.609+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/1001732602 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47a410fbf0 0x7f47a4114c30 unknown :-1 s=CLOSED pgs=103 gs=2 cs=0 l=1 c_cookie=1455639920758580146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.609+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/1001732602 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47a410f200 0x7f47a410f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.609+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/1001732602 >> 10.20.193.40:0/1001732602 conn(0x7f47a40ecb00 msgr2=0x7f47a410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.610+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/1001732602 shutdown_connections 2026-02-13T01:24:09.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.611+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/1001732602 wait complete. 2026-02-13T01:24:09.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.612+0000 7f47ac62f6c0 1 Processor -- start 2026-02-13T01:24:09.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.612+0000 7f47ac62f6c0 1 -- start start 2026-02-13T01:24:09.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47ac62f6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47a410f200 0x7f47a40f4920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47ac62f6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47a4115410 0x7f47a4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47ac62f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47a40f4f50 0x7f47a40fa220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.616 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T01:24:09.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47ac62f6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f47a40f5640 con 0x7f47a4115410 2026-02-13T01:24:09.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47ac62f6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f47a40fa760 con 0x7f47a40f4f50 2026-02-13T01:24:09.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47ac62f6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f47a40fa920 con 0x7f47a410f200 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47aa3a06c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47a410f200 0x7f47a40f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47aaba16c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47a40f4f50 0x7f47a40fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47aaba16c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47a40f4f50 0x7f47a40fa220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33922/0 (socket says 10.20.193.40:33922) 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.613+0000 7f47aaba16c0 1 -- 10.20.193.40:0/3622871677 learned_addr learned my addr 10.20.193.40:0/3622871677 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.614+0000 7f47a9b9f6c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47a4115410 0x7f47a4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.614+0000 7f47aaba16c0 1 -- 10.20.193.40:0/3622871677 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47a410f200 msgr2=0x7f47a40f4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.614+0000 7f47aaba16c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47a410f200 0x7f47a40f4920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.614+0000 7f47aaba16c0 1 -- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47a4115410 msgr2=0x7f47a4175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.614+0000 7f47aaba16c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47a4115410 0x7f47a4175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.614+0000 7f47aaba16c0 1 -- 10.20.193.40:0/3622871677 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4794009590 con 0x7f47a40f4f50 2026-02-13T01:24:09.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.614+0000 7f47a9b9f6c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47a4115410 0x7f47a4175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:09.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.614+0000 7f47aaba16c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47a40f4f50 0x7f47a40fa220 secure :-1 s=READY pgs=98 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4798009fd0 tx=0x7f479800bb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.615+0000 7f47937fe6c0 1 -- 10.20.193.40:0/3622871677 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4798004250 con 0x7f47a40f4f50 2026-02-13T01:24:09.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.615+0000 7f47937fe6c0 1 -- 10.20.193.40:0/3622871677 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4798009070 con 0x7f47a40f4f50 2026-02-13T01:24:09.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.615+0000 7f47937fe6c0 1 -- 10.20.193.40:0/3622871677 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47980071c0 con 0x7f47a40f4f50 2026-02-13T01:24:09.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.615+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a40fac00 con 0x7f47a40f4f50 2026-02-13T01:24:09.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.615+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a40fb090 con 0x7f47a40f4f50 2026-02-13T01:24:09.620 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.616+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f476c005310 con 0x7f47a40f4f50 2026-02-13T01:24:09.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.618+0000 7f47937fe6c0 1 -- 10.20.193.40:0/3622871677 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f47980043b0 con 0x7f47a40f4f50 2026-02-13T01:24:09.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.619+0000 7f47937fe6c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47880b57b0 0x7f47880d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.620+0000 7f47937fe6c0 1 -- 10.20.193.40:0/3622871677 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f47980e3a10 con 0x7f47a40f4f50 2026-02-13T01:24:09.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.620+0000 7f47aa3a06c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47880b57b0 0x7f47880d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.625 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.624+0000 7ff3675776c0 1 -- 10.20.193.40:0/1552950067 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff36810f060 msgr2=0x7ff36810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.624+0000 7ff3675776c0 1 --2- 10.20.193.40:0/1552950067 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff36810f060 0x7ff36810f430 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=3799059086514784030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff35c009b30 tx=0x7ff35c02ef10 comp rx=0 tx=0).stop 2026-02-13T01:24:09.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.625+0000 7ff3675776c0 1 -- 10.20.193.40:0/1552950067 shutdown_connections 2026-02-13T01:24:09.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.625+0000 7ff3675776c0 1 --2- 10.20.193.40:0/1552950067 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff368115270 0x7ff368175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.625+0000 7ff3675776c0 1 --2- 10.20.193.40:0/1552950067 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff36810fa50 0x7ff368114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.625+0000 7ff3675776c0 1 --2- 10.20.193.40:0/1552950067 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff36810f060 0x7ff36810f430 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=3799059086514784030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.625+0000 7ff3675776c0 1 -- 10.20.193.40:0/1552950067 >> 10.20.193.40:0/1552950067 conn(0x7ff3680ec980 msgr2=0x7ff36810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.625+0000 7ff3675776c0 1 -- 10.20.193.40:0/1552950067 shutdown_connections 2026-02-13T01:24:09.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.625+0000 7ff3675776c0 1 -- 10.20.193.40:0/1552950067 wait complete. 2026-02-13T01:24:09.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.626+0000 7ff3675776c0 1 Processor -- start 2026-02-13T01:24:09.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.626+0000 7ff3675776c0 1 -- start start 2026-02-13T01:24:09.628 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff3675776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff36810f060 0x7ff368056a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.628 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff3675776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff368115270 0x7ff368056fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff3675776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff36805c370 0x7ff36805c810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff3675776c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff36805cd80 con 0x7ff368115270 2026-02-13T01:24:09.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff3675776c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff36805cef0 con 0x7ff36810f060 2026-02-13T01:24:09.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff3675776c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff36805d0b0 con 0x7ff36805c370 2026-02-13T01:24:09.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff365d746c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff368115270 0x7ff368056fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff365d746c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff368115270 0x7ff368056fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33952/0 (socket says 10.20.193.40:33952) 2026-02-13T01:24:09.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff365d746c0 1 -- 10.20.193.40:0/2613751297 learned_addr learned my addr 10.20.193.40:0/2613751297 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:09.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff365d746c0 1 -- 10.20.193.40:0/2613751297 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff36805c370 msgr2=0x7ff36805c810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:24:09.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff365d746c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff36805c370 0x7ff36805c810 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff365d746c0 1 -- 10.20.193.40:0/2613751297 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff36810f060 msgr2=0x7ff368056a70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:24:09.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff365d746c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff36810f060 0x7ff368056a70 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.627+0000 7ff365d746c0 1 -- 10.20.193.40:0/2613751297 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3500094c0 con 0x7ff368115270 2026-02-13T01:24:09.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.628+0000 7ff365d746c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff368115270 0x7ff368056fb0 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff35000bbc0 tx=0x7ff35000bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.628+0000 7ff3577fe6c0 1 -- 10.20.193.40:0/2613751297 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff350004250 con 0x7ff368115270 2026-02-13T01:24:09.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.628+0000 7ff3577fe6c0 1 -- 10.20.193.40:0/2613751297 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff350009070 con 0x7ff368115270 2026-02-13T01:24:09.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.628+0000 7ff3675776c0 1 -- 10.20.193.40:0/2613751297 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35c0094c0 con 0x7ff368115270 2026-02-13T01:24:09.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.628+0000 7ff3577fe6c0 1 -- 10.20.193.40:0/2613751297 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff350004250 con 0x7ff368115270 2026-02-13T01:24:09.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.630+0000 7ff3675776c0 1 -- 10.20.193.40:0/2613751297 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36805d890 con 0x7ff368115270 2026-02-13T01:24:09.633 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.631+0000 7ff3557fa6c0 1 -- 10.20.193.40:0/2613751297 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff368110330 con 0x7ff368115270 2026-02-13T01:24:09.633 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.632+0000 7ff3577fe6c0 1 -- 10.20.193.40:0/2613751297 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff3500043b0 con 0x7ff368115270 2026-02-13T01:24:09.638 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.636+0000 7ff3577fe6c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff33c0b5740 0x7ff33c0d5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.638 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.636+0000 7ff3577fe6c0 1 -- 10.20.193.40:0/2613751297 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7ff3500e6070 con 0x7ff368115270 2026-02-13T01:24:09.638 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.636+0000 7ff3665756c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff33c0b5740 0x7ff33c0d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.638 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.637+0000 7ff3577fe6c0 1 -- 10.20.193.40:0/2613751297 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff3500e6320 con 0x7ff368115270 2026-02-13T01:24:09.639 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.637+0000 7ff3665756c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff33c0b5740 0x7ff33c0d5bf0 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff35c02f420 tx=0x7ff35c0023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.621+0000 7f47937fe6c0 1 -- 10.20.193.40:0/3622871677 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f47980a63a0 con 0x7f47a40f4f50 2026-02-13T01:24:09.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.624+0000 7f47aa3a06c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47880b57b0 0x7f47880d5c60 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47a0005830 tx=0x7f47a000a4b0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.663 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T01:24:09.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.699+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/810261470 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4f80112ff0 msgr2=0x7f4f80173990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.699+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/810261470 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4f80112ff0 0x7f4f80173990 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=15965238292336770346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f70009970 tx=0x7f4f7002ed10 comp rx=0 tx=0).stop 2026-02-13T01:24:09.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.699+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/810261470 shutdown_connections 2026-02-13T01:24:09.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.699+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/810261470 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4f80112ff0 0x7f4f80173990 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=15965238292336770346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.699+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/810261470 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4f8010d7d0 0x7f4f80112810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.699+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/810261470 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4f8010cde0 0x7f4f8010d1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.699+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/810261470 >> 10.20.193.40:0/810261470 conn(0x7f4f800ea6a0 msgr2=0x7f4f8010aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.700+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/810261470 shutdown_connections 2026-02-13T01:24:09.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.700+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/810261470 wait complete. 2026-02-13T01:24:09.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.700+0000 7f4f8586f6c0 1 Processor -- start 2026-02-13T01:24:09.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f8586f6c0 1 -- start start 2026-02-13T01:24:09.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f8586f6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4f8010cde0 0x7f4f800f4720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f8586f6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4f80112ff0 0x7f4f80173890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f8586f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4f800f4d50 0x7f4f800fa020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f8586f6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800f5440 con 0x7f4f80112ff0 2026-02-13T01:24:09.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f8586f6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800fa560 con 0x7f4f800f4d50 2026-02-13T01:24:09.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f8586f6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800fa720 con 0x7f4f8010cde0 2026-02-13T01:24:09.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f8486d6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4f8010cde0 0x7f4f800f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f7ffff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4f80112ff0 0x7f4f80173890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f7ffff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4f80112ff0 0x7f4f80173890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33970/0 (socket says 10.20.193.40:33970) 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.701+0000 7f4f7ffff6c0 1 -- 10.20.193.40:0/598508119 learned_addr learned my addr 10.20.193.40:0/598508119 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.702+0000 7f4f8486d6c0 1 -- 10.20.193.40:0/598508119 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4f800f4d50 msgr2=0x7f4f800fa020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.702+0000 7f4f8486d6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4f800f4d50 0x7f4f800fa020 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.702+0000 7f4f8486d6c0 1 -- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4f80112ff0 msgr2=0x7f4f80173890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.702+0000 7f4f8486d6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4f80112ff0 0x7f4f80173890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.702+0000 7f4f8486d6c0 1 -- 10.20.193.40:0/598508119 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f70009590 con 0x7f4f8010cde0 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.702+0000 7f4f7ffff6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4f80112ff0 0x7f4f80173890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:09.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.702+0000 7f4f8486d6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4f8010cde0 0x7f4f800f4720 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f7400c750 tx=0x7f4f7400cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.704+0000 7f4f7dffb6c0 1 -- 10.20.193.40:0/598508119 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f74005280 con 0x7f4f8010cde0 2026-02-13T01:24:09.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.704+0000 7f4f7dffb6c0 1 -- 10.20.193.40:0/598508119 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4f74003d40 con 0x7f4f8010cde0 2026-02-13T01:24:09.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.704+0000 7f4f7dffb6c0 1 -- 10.20.193.40:0/598508119 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f7400de80 con 0x7f4f8010cde0 2026-02-13T01:24:09.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.704+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f800faa00 con 0x7f4f8010cde0 2026-02-13T01:24:09.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.704+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f800561d0 con 0x7f4f8010cde0 2026-02-13T01:24:09.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.705+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f48005310 con 0x7f4f8010cde0 2026-02-13T01:24:09.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.706+0000 7f4f7dffb6c0 1 -- 10.20.193.40:0/598508119 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f4f740053e0 con 0x7f4f8010cde0 2026-02-13T01:24:09.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.708+0000 7f4f7dffb6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4f4c0b5820 0x7f4f4c0d5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.708+0000 7f4f7dffb6c0 1 -- 10.20.193.40:0/598508119 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f4f740e4ae0 con 0x7f4f8010cde0 2026-02-13T01:24:09.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.708+0000 7f4f7ffff6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4f4c0b5820 0x7f4f4c0d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.709+0000 7f4f7ffff6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4f4c0b5820 0x7f4f4c0d5cd0 secure :-1 s=READY pgs=183 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f800fb0b0 tx=0x7f4f6c0094a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.711 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.710+0000 7f4f7dffb6c0 1 -- 10.20.193.40:0/598508119 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4f740a7470 con 0x7f4f8010cde0 2026-02-13T01:24:09.735 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.734+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f476c0055c0 con 0x7f47a40f4f50 2026-02-13T01:24:09.736 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.735+0000 7f47937fe6c0 1 -- 10.20.193.40:0/3622871677 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f479800c510 con 0x7f47a40f4f50 2026-02-13T01:24:09.737 INFO:teuthology.orchestra.run.trial040.stdout:124554051605 2026-02-13T01:24:09.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.738+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47880b57b0 msgr2=0x7f47880d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.738+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47880b57b0 0x7f47880d5c60 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47a0005830 tx=0x7f47a000a4b0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.739+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47a40f4f50 msgr2=0x7f47a40fa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.740 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.739+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47a40f4f50 0x7f47a40fa220 secure :-1 s=READY pgs=98 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4798009fd0 tx=0x7f479800bb60 comp rx=0 tx=0).stop 2026-02-13T01:24:09.741 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.739+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa9300055c0 con 0x7fa96000eb50 2026-02-13T01:24:09.741 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.740+0000 7fa94f7fe6c0 1 -- 10.20.193.40:0/1144000527 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa95c0ceb30 con 0x7fa96000eb50 2026-02-13T01:24:09.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.741+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 shutdown_connections 2026-02-13T01:24:09.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.741+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47880b57b0 0x7f47880d5c60 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.741+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47a40f4f50 0x7f47a40fa220 unknown :-1 s=CLOSED pgs=98 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.742 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.741+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47a4115410 0x7f47a4175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.743 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.741+0000 7f47ac62f6c0 1 --2- 10.20.193.40:0/3622871677 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47a410f200 0x7f47a40f4920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.743 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.741+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 >> 10.20.193.40:0/3622871677 conn(0x7f47a40ecb00 msgr2=0x7f47a410d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.743 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.741+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 shutdown_connections 2026-02-13T01:24:09.743 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.741+0000 7f47ac62f6c0 1 -- 10.20.193.40:0/3622871677 wait complete. 2026-02-13T01:24:09.748 INFO:teuthology.orchestra.run.trial040.stdout:51539607578 2026-02-13T01:24:09.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.747+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa9440b58a0 msgr2=0x7fa9440d5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.747+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa9440b58a0 0x7fa9440d5d50 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9600bfec0 tx=0x7fa950009260 comp rx=0 tx=0).stop 2026-02-13T01:24:09.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 msgr2=0x7fa9600be390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 0x7fa9600be390 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa95c005ae0 tx=0x7fa95c02f840 comp rx=0 tx=0).stop 2026-02-13T01:24:09.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 shutdown_connections 2026-02-13T01:24:09.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa9440b58a0 0x7fa9440d5d50 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa9600be9f0 0x7fa9600b75e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa9600bf320 0x7fa960121de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 --2- 10.20.193.40:0/1144000527 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa96000eb50 0x7fa9600be390 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 >> 10.20.193.40:0/1144000527 conn(0x7fa96000c400 msgr2=0x7fa9600a0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 shutdown_connections 2026-02-13T01:24:09.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.749+0000 7fa9675776c0 1 -- 10.20.193.40:0/1144000527 wait complete. 2026-02-13T01:24:09.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.806+0000 7ff3557fa6c0 1 -- 10.20.193.40:0/2613751297 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff36810fa50 con 0x7ff368115270 2026-02-13T01:24:09.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.806+0000 7ff3577fe6c0 1 -- 10.20.193.40:0/2613751297 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff3500a6500 con 0x7ff368115270 2026-02-13T01:24:09.809 INFO:teuthology.orchestra.run.trial040.stdout:188978561040 2026-02-13T01:24:09.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.809+0000 7ff3557fa6c0 1 -- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff33c0b5740 msgr2=0x7ff33c0d5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.809+0000 7ff3557fa6c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff33c0b5740 0x7ff33c0d5bf0 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff35c02f420 tx=0x7ff35c0023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.809+0000 7ff3557fa6c0 1 -- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff368115270 msgr2=0x7ff368056fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.809+0000 7ff3557fa6c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff368115270 0x7ff368056fb0 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff35000bbc0 tx=0x7ff35000bcc0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.810+0000 7ff3557fa6c0 1 -- 10.20.193.40:0/2613751297 shutdown_connections 2026-02-13T01:24:09.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.810+0000 7ff3557fa6c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff33c0b5740 0x7ff33c0d5bf0 unknown :-1 s=CLOSED pgs=182 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.810+0000 7ff3557fa6c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff36805c370 0x7ff36805c810 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.810+0000 7ff3557fa6c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff368115270 0x7ff368056fb0 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.810+0000 7ff3557fa6c0 1 --2- 10.20.193.40:0/2613751297 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff36810f060 0x7ff368056a70 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.810+0000 7ff3557fa6c0 1 -- 10.20.193.40:0/2613751297 >> 10.20.193.40:0/2613751297 conn(0x7ff3680ec980 msgr2=0x7ff36810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.810+0000 7ff3557fa6c0 1 -- 10.20.193.40:0/2613751297 shutdown_connections 2026-02-13T01:24:09.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.810+0000 7ff3557fa6c0 1 -- 10.20.193.40:0/2613751297 wait complete. 2026-02-13T01:24:09.825 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.846+0000 7f53f77536c0 1 -- 10.20.193.40:0/3358676652 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f01149f0 msgr2=0x7f53f01161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.846+0000 7f53f77536c0 1 --2- 10.20.193.40:0/3358676652 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f01149f0 0x7f53f01161e0 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=13476303802233716156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53dc009fd0 tx=0x7f53dc02fe60 comp rx=0 tx=0).stop 2026-02-13T01:24:09.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.846+0000 7f53f77536c0 1 -- 10.20.193.40:0/3358676652 shutdown_connections 2026-02-13T01:24:09.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.846+0000 7f53f77536c0 1 --2- 10.20.193.40:0/3358676652 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f53f0116990 0x7f53f017a5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.846+0000 7f53f77536c0 1 --2- 10.20.193.40:0/3358676652 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f01149f0 0x7f53f01161e0 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=13476303802233716156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.846+0000 7f53f77536c0 1 --2- 10.20.193.40:0/3358676652 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f53f0114000 0x7f53f01143d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.846+0000 7f53f77536c0 1 -- 10.20.193.40:0/3358676652 >> 10.20.193.40:0/3358676652 conn(0x7f53f005aaa0 msgr2=0x7f53f005b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.846+0000 7f53f77536c0 1 -- 10.20.193.40:0/3358676652 shutdown_connections 2026-02-13T01:24:09.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.847+0000 7f53f77536c0 1 -- 10.20.193.40:0/3358676652 wait complete. 2026-02-13T01:24:09.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.848+0000 7f53f77536c0 1 Processor -- start 2026-02-13T01:24:09.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.848+0000 7f53f77536c0 1 -- start start 2026-02-13T01:24:09.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.848+0000 7f53f77536c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f0114000 0x7f53f011d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.849+0000 7f53f77536c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f53f0116990 0x7f53f011d9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.849+0000 7f53f77536c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f53f0122d70 0x7f53f0123210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.849+0000 7f53f77536c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f53f0123780 con 0x7f53f0116990 2026-02-13T01:24:09.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.849+0000 7f53f77536c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f53f01238f0 con 0x7f53f0122d70 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.849+0000 7f53f77536c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f53f0123ab0 con 0x7f53f0114000 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.849+0000 7f53f67516c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f0114000 0x7f53f011d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.849+0000 7f53f67516c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f0114000 0x7f53f011d470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:52264/0 (socket says 10.20.193.40:52264) 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.849+0000 7f53f67516c0 1 -- 10.20.193.40:0/1061196735 learned_addr learned my addr 10.20.193.40:0/1061196735 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.849+0000 7f53f6f526c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f53f0122d70 0x7f53f0123210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.850+0000 7f53f67516c0 1 -- 10.20.193.40:0/1061196735 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f53f0122d70 msgr2=0x7f53f0123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.850+0000 7f53f67516c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f53f0122d70 0x7f53f0123210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.850+0000 7f53f67516c0 1 -- 10.20.193.40:0/1061196735 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f53f0116990 msgr2=0x7f53f011d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.850+0000 7f53f67516c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f53f0116990 0x7f53f011d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.850+0000 7f53f67516c0 1 -- 10.20.193.40:0/1061196735 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e80094c0 con 0x7f53f0114000 2026-02-13T01:24:09.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.850+0000 7f53f6f526c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f53f0122d70 0x7f53f0123210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.850+0000 7f53f67516c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f0114000 0x7f53f011d470 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53e800ba30 tx=0x7f53e800bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.850+0000 7f53db7fe6c0 1 -- 10.20.193.40:0/1061196735 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53e80044a0 con 0x7f53f0114000 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.850+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc009e40 con 0x7f53f0114000 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.851+0000 7f53db7fe6c0 1 -- 10.20.193.40:0/1061196735 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f53e8009030 con 0x7f53f0114000 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.851+0000 7f53db7fe6c0 1 -- 10.20.193.40:0/1061196735 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53e80044a0 con 0x7f53f0114000 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.851+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f01642b0 con 0x7f53f0114000 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.853+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f01143d0 con 0x7f53f0114000 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.854+0000 7f53db7fe6c0 1 -- 10.20.193.40:0/1061196735 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f53e800c690 con 0x7f53f0114000 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.855+0000 7f53db7fe6c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53cc0b57c0 0x7f53cc0d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.855+0000 7f53db7fe6c0 1 -- 10.20.193.40:0/1061196735 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f53e80e3a30 con 0x7f53f0114000 2026-02-13T01:24:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.855+0000 7f53f5f506c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53cc0b57c0 0x7f53cc0d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.857+0000 7f53db7fe6c0 1 -- 10.20.193.40:0/1061196735 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f53e80a63c0 con 0x7f53f0114000 2026-02-13T01:24:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.859+0000 7f53f5f506c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53cc0b57c0 0x7f53cc0d5c70 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f0123e00 tx=0x7f53dc002f20 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.865+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4f480055c0 con 0x7f4f8010cde0 2026-02-13T01:24:09.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.866+0000 7f4f7dffb6c0 1 -- 10.20.193.40:0/598508119 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4f740a7470 con 0x7f4f8010cde0 2026-02-13T01:24:09.867 INFO:teuthology.orchestra.run.trial040.stdout:171798691858 2026-02-13T01:24:09.870 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4f4c0b5820 msgr2=0x7f4f4c0d5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4f4c0b5820 0x7f4f4c0d5cd0 secure :-1 s=READY pgs=183 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f800fb0b0 tx=0x7f4f6c0094a0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4f8010cde0 msgr2=0x7f4f800f4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4f8010cde0 0x7f4f800f4720 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f7400c750 tx=0x7f4f7400cc20 comp rx=0 tx=0).stop 2026-02-13T01:24:09.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 shutdown_connections 2026-02-13T01:24:09.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4f4c0b5820 0x7f4f4c0d5cd0 unknown :-1 s=CLOSED pgs=183 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4f800f4d50 0x7f4f800fa020 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4f80112ff0 0x7f4f80173890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 --2- 10.20.193.40:0/598508119 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4f8010cde0 0x7f4f800f4720 unknown :-1 s=CLOSED pgs=104 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 >> 10.20.193.40:0/598508119 conn(0x7f4f800ea6a0 msgr2=0x7f4f8010e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 shutdown_connections 2026-02-13T01:24:09.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.877+0000 7f4f8586f6c0 1 -- 10.20.193.40:0/598508119 wait complete. 2026-02-13T01:24:09.930 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.931 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.938 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.966 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607578 got 51539607578 for osd.1 2026-02-13T01:24:09.966 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:09.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.966+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f53f017d270 con 0x7f53f0114000 2026-02-13T01:24:09.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.966+0000 7f53db7fe6c0 1 -- 10.20.193.40:0/1061196735 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f53e80a9570 con 0x7f53f0114000 2026-02-13T01:24:09.968 INFO:teuthology.orchestra.run.trial040.stdout:296352743433 2026-02-13T01:24:09.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53cc0b57c0 msgr2=0x7f53cc0d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53cc0b57c0 0x7f53cc0d5c70 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f0123e00 tx=0x7f53dc002f20 comp rx=0 tx=0).stop 2026-02-13T01:24:09.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f0114000 msgr2=0x7f53f011d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f0114000 0x7f53f011d470 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53e800ba30 tx=0x7f53e800bf00 comp rx=0 tx=0).stop 2026-02-13T01:24:09.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 shutdown_connections 2026-02-13T01:24:09.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f53cc0b57c0 0x7f53cc0d5c70 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f53f0122d70 0x7f53f0123210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f53f0116990 0x7f53f011d9b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 --2- 10.20.193.40:0/1061196735 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f53f0114000 0x7f53f011d470 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.968+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 >> 10.20.193.40:0/1061196735 conn(0x7f53f005aaa0 msgr2=0x7f53f01179b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.975+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 shutdown_connections 2026-02-13T01:24:09.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:09.975+0000 7f53f77536c0 1 -- 10.20.193.40:0/1061196735 wait complete. 2026-02-13T01:24:10.051 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:10.067 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051605 got 124554051605 for osd.4 2026-02-13T01:24:10.067 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.068 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561040 got 188978561040 for osd.7 2026-02-13T01:24:10.069 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.126 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691857 got 171798691858 for osd.6 2026-02-13T01:24:10.127 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.147 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743433 got 296352743433 for osd.11 2026-02-13T01:24:10.147 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:10 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3622871677' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:24:10.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:10 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1144000527' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:24:10.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:10 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2613751297' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:24:10.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:10 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/598508119' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:24:10.166 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:10 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1061196735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:24:10.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.274+0000 7efc1fcbd6c0 1 -- 10.20.193.40:0/1517400862 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc1810f200 msgr2=0x7efc1810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.274+0000 7efc1fcbd6c0 1 --2- 10.20.193.40:0/1517400862 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc1810f200 0x7efc1810f5d0 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=487596721034953489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc080098d0 tx=0x7efc0802ec40 comp rx=0 tx=0).stop 2026-02-13T01:24:10.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.274+0000 7efc1fcbd6c0 1 -- 10.20.193.40:0/1517400862 shutdown_connections 2026-02-13T01:24:10.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.274+0000 7efc1fcbd6c0 1 --2- 10.20.193.40:0/1517400862 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efc18115410 0x7efc18175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.274+0000 7efc1fcbd6c0 1 --2- 10.20.193.40:0/1517400862 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efc1810fbf0 0x7efc18114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.274+0000 7efc1fcbd6c0 1 --2- 10.20.193.40:0/1517400862 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc1810f200 0x7efc1810f5d0 unknown :-1 s=CLOSED pgs=235 gs=1 cs=0 l=1 c_cookie=487596721034953489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.274+0000 7efc1fcbd6c0 1 -- 10.20.193.40:0/1517400862 >> 10.20.193.40:0/1517400862 conn(0x7efc180ecb00 msgr2=0x7efc1810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.274+0000 7efc1fcbd6c0 1 -- 10.20.193.40:0/1517400862 shutdown_connections 2026-02-13T01:24:10.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.274+0000 7efc1fcbd6c0 1 -- 10.20.193.40:0/1517400862 wait complete. 2026-02-13T01:24:10.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.275+0000 7efc1fcbd6c0 1 Processor -- start 2026-02-13T01:24:10.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.275+0000 7efc1fcbd6c0 1 -- start start 2026-02-13T01:24:10.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.276+0000 7efc1fcbd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efc1810f200 0x7efc1810ce30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.276+0000 7efc1fcbd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc18115410 0x7efc18175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.276+0000 7efc1fcbd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efc1810a0f0 0x7efc1810a590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.276+0000 7efc1fcbd6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efc1810ab60 con 0x7efc18115410 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.276+0000 7efc1fcbd6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7efc1810acd0 con 0x7efc1810a0f0 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.276+0000 7efc1fcbd6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7efc1810ae90 con 0x7efc1810f200 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1e22f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efc1810a0f0 0x7efc1810a590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1e22f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efc1810a0f0 0x7efc1810a590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:50374/0 (socket says 10.20.193.40:50374) 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1e22f6c0 1 -- 10.20.193.40:0/3692212676 learned_addr learned my addr 10.20.193.40:0/3692212676 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1da2e6c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efc1810f200 0x7efc1810ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1d22d6c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc18115410 0x7efc18175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1e22f6c0 1 -- 10.20.193.40:0/3692212676 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efc1810f200 msgr2=0x7efc1810ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1e22f6c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efc1810f200 0x7efc1810ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1e22f6c0 1 -- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc18115410 msgr2=0x7efc18175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1e22f6c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc18115410 0x7efc18175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1e22f6c0 1 -- 10.20.193.40:0/3692212676 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1400a5b0 con 0x7efc1810a0f0 2026-02-13T01:24:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.277+0000 7efc1d22d6c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc18115410 0x7efc18175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.278+0000 7efc1e22f6c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efc1810a0f0 0x7efc1810a590 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc1400a820 tx=0x7efc1400ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.278+0000 7efc06ffd6c0 1 -- 10.20.193.40:0/3692212676 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc14003c40 con 0x7efc1810a0f0 2026-02-13T01:24:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.278+0000 7efc06ffd6c0 1 -- 10.20.193.40:0/3692212676 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efc1400a070 con 0x7efc1810a0f0 2026-02-13T01:24:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.278+0000 7efc06ffd6c0 1 -- 10.20.193.40:0/3692212676 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc14008440 con 0x7efc1810a0f0 2026-02-13T01:24:10.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.279+0000 7efc1fcbd6c0 1 -- 10.20.193.40:0/3692212676 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc080094c0 con 0x7efc1810a0f0 2026-02-13T01:24:10.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.279+0000 7efc1fcbd6c0 1 -- 10.20.193.40:0/3692212676 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc180f02c0 con 0x7efc1810a0f0 2026-02-13T01:24:10.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.280+0000 7efc04ff96c0 1 -- 10.20.193.40:0/3692212676 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc181104d0 con 0x7efc1810a0f0 2026-02-13T01:24:10.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.282+0000 7efc06ffd6c0 1 -- 10.20.193.40:0/3692212676 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7efc1400d830 con 0x7efc1810a0f0 2026-02-13T01:24:10.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.283+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3685874523 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff65810fbf0 msgr2=0x7ff658114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.283+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3685874523 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff65810fbf0 0x7ff658114c30 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=1690694067455989168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff640009970 tx=0x7ff64002ed50 comp rx=0 tx=0).stop 2026-02-13T01:24:10.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.283+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3685874523 shutdown_connections 2026-02-13T01:24:10.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.283+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3685874523 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff658115410 0x7ff658175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.283+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3685874523 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff65810fbf0 0x7ff658114c30 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=1690694067455989168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.283+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3685874523 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff65810f200 0x7ff65810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.283+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3685874523 >> 10.20.193.40:0/3685874523 conn(0x7ff6580ecb00 msgr2=0x7ff65810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.283+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3685874523 shutdown_connections 2026-02-13T01:24:10.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.283+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3685874523 wait complete. 2026-02-13T01:24:10.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7eff3708f6c0 1 -- 10.20.193.40:0/441800658 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7eff301137a0 msgr2=0x7eff30113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/441800658 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7eff301137a0 0x7eff30113b70 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=11275570938217432249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff18009970 tx=0x7eff1802ed50 comp rx=0 tx=0).stop 2026-02-13T01:24:10.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7efc06ffd6c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbf40b5760 0x7efbf40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7eff3708f6c0 1 -- 10.20.193.40:0/441800658 shutdown_connections 2026-02-13T01:24:10.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/441800658 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7eff301198f0 0x7eff3017a2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7efc06ffd6c0 1 -- 10.20.193.40:0/3692212676 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7efc140e4e10 con 0x7efc1810a0f0 2026-02-13T01:24:10.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7efc06ffd6c0 1 -- 10.20.193.40:0/3692212676 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efc140e5290 con 0x7efc1810a0f0 2026-02-13T01:24:10.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/441800658 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7eff30114190 0x7eff30119140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/441800658 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7eff301137a0 0x7eff30113b70 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=11275570938217432249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7eff3708f6c0 1 -- 10.20.193.40:0/441800658 >> 10.20.193.40:0/441800658 conn(0x7eff30060760 msgr2=0x7eff30060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7efc1da2e6c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbf40b5760 0x7efbf40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.285+0000 7eff3708f6c0 1 -- 10.20.193.40:0/441800658 shutdown_connections 2026-02-13T01:24:10.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.285+0000 7eff3708f6c0 1 -- 10.20.193.40:0/441800658 wait complete. 2026-02-13T01:24:10.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7ff65ca046c0 1 Processor -- start 2026-02-13T01:24:10.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.284+0000 7ff65ca046c0 1 -- start start 2026-02-13T01:24:10.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.285+0000 7efc1da2e6c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbf40b5760 0x7efbf40d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc080097f0 tx=0x7efc080023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.285+0000 7ff65ca046c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff65810f200 0x7ff65811ac20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.285+0000 7ff65ca046c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff658115410 0x7ff65811b160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.285+0000 7ff655d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff658115410 0x7ff65811b160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.286+0000 7ff655d746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff658115410 0x7ff65811b160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:39170/0 (socket says 10.20.193.40:39170) 2026-02-13T01:24:10.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.286+0000 7ff655d746c0 1 -- 10.20.193.40:0/3123763107 learned_addr learned my addr 10.20.193.40:0/3123763107 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:10.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.286+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff658120520 0x7ff6581209c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.286+0000 7eff3708f6c0 1 Processor -- start 2026-02-13T01:24:10.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.286+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff658120f30 con 0x7ff65810f200 2026-02-13T01:24:10.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.286+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581210a0 con 0x7ff658120520 2026-02-13T01:24:10.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.286+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff658121260 con 0x7ff658115410 2026-02-13T01:24:10.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.286+0000 7ff6565756c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff65810f200 0x7ff65811ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.286+0000 7eff3708f6c0 1 -- start start 2026-02-13T01:24:10.293 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff656d766c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff658120520 0x7ff6581209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.293 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff655d746c0 1 -- 10.20.193.40:0/3123763107 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff658120520 msgr2=0x7ff6581209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.293 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff655d746c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff658120520 0x7ff6581209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff655d746c0 1 -- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff65810f200 msgr2=0x7ff65811ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff655d746c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff65810f200 0x7ff65811ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff655d746c0 1 -- 10.20.193.40:0/3123763107 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c0094c0 con 0x7ff658115410 2026-02-13T01:24:10.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff656d766c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff658120520 0x7ff6581209c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:10.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff6565756c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff65810f200 0x7ff65811ac20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:10.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff655d746c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff658115410 0x7ff65811b160 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6400092b0 tx=0x7ff64002f7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff3708f6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7eff301137a0 0x7eff3011a3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff3708f6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7eff301198f0 0x7eff3011a8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff3708f6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7eff3015f270 0x7eff3015f710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff3708f6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7eff3011b0d0 con 0x7eff3015f270 2026-02-13T01:24:10.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff3708f6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7eff3015fc80 con 0x7eff301137a0 2026-02-13T01:24:10.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff3708f6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7eff3015fe40 con 0x7eff301198f0 2026-02-13T01:24:10.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff27fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7eff301198f0 0x7eff3011a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff27fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7eff301198f0 0x7eff3011a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:39176/0 (socket says 10.20.193.40:39176) 2026-02-13T01:24:10.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff27fff6c0 1 -- 10.20.193.40:0/49085133 learned_addr learned my addr 10.20.193.40:0/49085133 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:10.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff27fff6c0 1 -- 10.20.193.40:0/49085133 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7eff301137a0 msgr2=0x7eff3011a3b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:24:10.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff27fff6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7eff301137a0 0x7eff3011a3b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff27fff6c0 1 -- 10.20.193.40:0/49085133 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7eff3015f270 msgr2=0x7eff3015f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff27fff6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7eff3015f270 0x7eff3015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7eff27fff6c0 1 -- 10.20.193.40:0/49085133 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff18009590 con 0x7eff301198f0 2026-02-13T01:24:10.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff63f7fe6c0 1 -- 10.20.193.40:0/3123763107 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff640002ae0 con 0x7ff658115410 2026-02-13T01:24:10.297 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.289+0000 7eff27fff6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7eff301198f0 0x7eff3011a8f0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff20009490 tx=0x7eff2000bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.297 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff640009590 con 0x7ff658115410 2026-02-13T01:24:10.297 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.287+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6581619a0 con 0x7ff658115410 2026-02-13T01:24:10.297 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.288+0000 7ff63f7fe6c0 1 -- 10.20.193.40:0/3123763107 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff64002f990 con 0x7ff658115410 2026-02-13T01:24:10.297 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.288+0000 7ff63f7fe6c0 1 -- 10.20.193.40:0/3123763107 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff640002ae0 con 0x7ff658115410 2026-02-13T01:24:10.297 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.288+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c005310 con 0x7ff658115410 2026-02-13T01:24:10.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.290+0000 7eff25ffb6c0 1 -- 10.20.193.40:0/49085133 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff20004a80 con 0x7eff301198f0 2026-02-13T01:24:10.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.290+0000 7eff25ffb6c0 1 -- 10.20.193.40:0/49085133 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7eff20009030 con 0x7eff301198f0 2026-02-13T01:24:10.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.290+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff30160120 con 0x7eff301198f0 2026-02-13T01:24:10.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.290+0000 7eff25ffb6c0 1 -- 10.20.193.40:0/49085133 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff200071c0 con 0x7eff301198f0 2026-02-13T01:24:10.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.291+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff301605b0 con 0x7eff301198f0 2026-02-13T01:24:10.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.291+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff301149e0 con 0x7eff301198f0 2026-02-13T01:24:10.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.292+0000 7ff63f7fe6c0 1 -- 10.20.193.40:0/3123763107 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff6400073f0 con 0x7ff658115410 2026-02-13T01:24:10.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.293+0000 7ff63f7fe6c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff62c0b57b0 0x7ff62c0d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.293+0000 7ff63f7fe6c0 1 -- 10.20.193.40:0/3123763107 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7ff6401078f0 con 0x7ff658115410 2026-02-13T01:24:10.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.294+0000 7eff25ffb6c0 1 -- 10.20.193.40:0/49085133 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7eff20004060 con 0x7eff301198f0 2026-02-13T01:24:10.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.295+0000 7ff63f7fe6c0 1 -- 10.20.193.40:0/3123763107 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff6400ca280 con 0x7ff658115410 2026-02-13T01:24:10.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.295+0000 7eff25ffb6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7eff000b5760 0x7eff000d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.295+0000 7ff6565756c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff62c0b57b0 0x7ff62c0d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.295+0000 7eff25ffb6c0 1 -- 10.20.193.40:0/49085133 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7eff200e3d20 con 0x7eff301198f0 2026-02-13T01:24:10.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.296+0000 7eff34e006c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7eff000b5760 0x7eff000d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.296+0000 7eff25ffb6c0 1 -- 10.20.193.40:0/49085133 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7eff200a6670 con 0x7eff301198f0 2026-02-13T01:24:10.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.297+0000 7eff34e006c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7eff000b5760 0x7eff000d5c10 secure :-1 s=READY pgs=187 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff180098c0 tx=0x7eff180023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.296+0000 7ff6565756c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff62c0b57b0 0x7ff62c0d5c60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff64c004750 tx=0x7ff64c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.301+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1308236196 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 msgr2=0x7f10f410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.301+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1308236196 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 0x7f10f410f430 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=14389197487353099191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10dc0099a0 tx=0x7f10dc02ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:10.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.301+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1308236196 shutdown_connections 2026-02-13T01:24:10.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.301+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1308236196 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f10f4115270 0x7f10f4175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.301+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1308236196 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f10f410fa50 0x7f10f4114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.301+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1308236196 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 0x7f10f410f430 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=14389197487353099191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.301+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1308236196 >> 10.20.193.40:0/1308236196 conn(0x7f10f40ec980 msgr2=0x7f10f410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.301+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1308236196 shutdown_connections 2026-02-13T01:24:10.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.301+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1308236196 wait complete. 2026-02-13T01:24:10.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f10f3fff6c0 1 Processor -- start 2026-02-13T01:24:10.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f7ed57cb6c0 1 -- 10.20.193.40:0/3800702832 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7ed0064720 msgr2=0x7f7ed00650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f7ed57cb6c0 1 --2- 10.20.193.40:0/3800702832 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7ed0064720 0x7f7ed00650e0 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=13585846537617685386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ec8008a20 tx=0x7f7ec8030f30 comp rx=0 tx=0).stop 2026-02-13T01:24:10.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f7ed57cb6c0 1 -- 10.20.193.40:0/3800702832 shutdown_connections 2026-02-13T01:24:10.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f7ed57cb6c0 1 --2- 10.20.193.40:0/3800702832 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7ed0064720 0x7f7ed00650e0 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=13585846537617685386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f7ed57cb6c0 1 --2- 10.20.193.40:0/3800702832 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ed005f810 0x7f7ed0063f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f7ed57cb6c0 1 --2- 10.20.193.40:0/3800702832 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7ed005ee20 0x7f7ed005f1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f7ed57cb6c0 1 -- 10.20.193.40:0/3800702832 >> 10.20.193.40:0/3800702832 conn(0x7f7ed00586e0 msgr2=0x7f7ed0058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f7ed57cb6c0 1 -- 10.20.193.40:0/3800702832 shutdown_connections 2026-02-13T01:24:10.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.302+0000 7f7ed57cb6c0 1 -- 10.20.193.40:0/3800702832 wait complete. 2026-02-13T01:24:10.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f7ed57cb6c0 1 Processor -- start 2026-02-13T01:24:10.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f7ed57cb6c0 1 -- start start 2026-02-13T01:24:10.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f70230886c0 1 -- 10.20.193.40:0/391693126 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f701c10fbf0 msgr2=0x7f701c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f70230886c0 1 --2- 10.20.193.40:0/391693126 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f701c10fbf0 0x7f701c114c30 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=7558709368591656819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70040098d0 tx=0x7f700402ec40 comp rx=0 tx=0).stop 2026-02-13T01:24:10.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f70230886c0 1 -- 10.20.193.40:0/391693126 shutdown_connections 2026-02-13T01:24:10.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f70230886c0 1 --2- 10.20.193.40:0/391693126 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f701c115410 0x7f701c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f7ed57cb6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7ed005ee20 0x7f7ed006eb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f70230886c0 1 --2- 10.20.193.40:0/391693126 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f701c10fbf0 0x7f701c114c30 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=7558709368591656819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f70230886c0 1 --2- 10.20.193.40:0/391693126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f701c10f200 0x7f701c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f70230886c0 1 -- 10.20.193.40:0/391693126 >> 10.20.193.40:0/391693126 conn(0x7f701c0ecb00 msgr2=0x7f701c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f7ed57cb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ed0064720 0x7f7ed006f040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f70230886c0 1 -- 10.20.193.40:0/391693126 shutdown_connections 2026-02-13T01:24:10.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f3fff6c0 1 -- start start 2026-02-13T01:24:10.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f3fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 0x7f10f411c980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f3fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f10f4115270 0x7f10f411cec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f3fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f10f4122230 0x7f10f41226d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f3fff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4122c10 con 0x7f10f4115270 2026-02-13T01:24:10.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f3fff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4122d50 con 0x7f10f4122230 2026-02-13T01:24:10.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f7ed57cb6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7ed00f4fb0 0x7f7ed00f5420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f7eceffd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7ed005ee20 0x7f7ed006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.305+0000 7f7eceffd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7ed005ee20 0x7f7ed006eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:39226/0 (socket says 10.20.193.40:39226) 2026-02-13T01:24:10.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.305+0000 7f7ed57cb6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed00f5a20 con 0x7f7ed0064720 2026-02-13T01:24:10.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.305+0000 7f7ed57cb6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed00f5b90 con 0x7f7ed00f4fb0 2026-02-13T01:24:10.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.305+0000 7f7eceffd6c0 1 -- 10.20.193.40:0/4076308284 learned_addr learned my addr 10.20.193.40:0/4076308284 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:10.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.305+0000 7f7ed57cb6c0 1 -- 10.20.193.40:0/4076308284 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed00f5d00 con 0x7f7ed005ee20 2026-02-13T01:24:10.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.305+0000 7f7ecf7fe6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7ed00f4fb0 0x7f7ed00f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.305+0000 7f7ece7fc6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ed0064720 0x7f7ed006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f3fff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4122f10 con 0x7f10f410f060 2026-02-13T01:24:10.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f2ffd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 0x7f10f411c980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f2ffd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 0x7f10f411c980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:39220/0 (socket says 10.20.193.40:39220) 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f2ffd6c0 1 -- 10.20.193.40:0/1305150433 learned_addr learned my addr 10.20.193.40:0/1305150433 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.303+0000 7f10f37fe6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f10f4122230 0x7f10f41226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f10f2ffd6c0 1 -- 10.20.193.40:0/1305150433 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f10f4122230 msgr2=0x7f10f41226d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f10f2ffd6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f10f4122230 0x7f10f41226d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f10f2ffd6c0 1 -- 10.20.193.40:0/1305150433 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f10f4115270 msgr2=0x7f10f411cec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f10f2ffd6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f10f4115270 0x7f10f411cec0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f10f2ffd6c0 1 -- 10.20.193.40:0/1305150433 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e400a5b0 con 0x7f10f410f060 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f10f2ffd6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 0x7f10f411c980 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10dc02f210 tx=0x7f10dc005f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f10d3fff6c0 1 -- 10.20.193.40:0/1305150433 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10dc02fd90 con 0x7f10f410f060 2026-02-13T01:24:10.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f10d3fff6c0 1 -- 10.20.193.40:0/1305150433 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f10dc056d80 con 0x7f10f410f060 2026-02-13T01:24:10.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f10d3fff6c0 1 -- 10.20.193.40:0/1305150433 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10dc02fd90 con 0x7f10f410f060 2026-02-13T01:24:10.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.305+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10dc009590 con 0x7f10f410f060 2026-02-13T01:24:10.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.305+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f4056380 con 0x7f10f410f060 2026-02-13T01:24:10.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.304+0000 7f70230886c0 1 -- 10.20.193.40:0/391693126 wait complete. 2026-02-13T01:24:10.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.306+0000 7f7eceffd6c0 1 -- 10.20.193.40:0/4076308284 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7ed00f4fb0 msgr2=0x7f7ed00f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.306+0000 7f7eceffd6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7ed00f4fb0 0x7f7ed00f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.306+0000 7f7eceffd6c0 1 -- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ed0064720 msgr2=0x7f7ed006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.306+0000 7f7eceffd6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ed0064720 0x7f7ed006f040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.306+0000 7f7eceffd6c0 1 -- 10.20.193.40:0/4076308284 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec40094c0 con 0x7f7ed005ee20 2026-02-13T01:24:10.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.306+0000 7f7ece7fc6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ed0064720 0x7f7ed006f040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:10.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.306+0000 7f70230886c0 1 Processor -- start 2026-02-13T01:24:10.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.307+0000 7f7eceffd6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7ed005ee20 0x7f7ed006eb00 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ec000b710 tx=0x7f7ec000bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.307+0000 7f7eaffff6c0 1 -- 10.20.193.40:0/4076308284 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ec0004250 con 0x7f7ed005ee20 2026-02-13T01:24:10.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.307+0000 7f7eaffff6c0 1 -- 10.20.193.40:0/4076308284 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7ec0009070 con 0x7f7ed005ee20 2026-02-13T01:24:10.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.307+0000 7f7eaffff6c0 1 -- 10.20.193.40:0/4076308284 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ec00071c0 con 0x7f7ed005ee20 2026-02-13T01:24:10.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f7ed57cb6c0 1 -- 10.20.193.40:0/4076308284 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec8008640 con 0x7f7ed005ee20 2026-02-13T01:24:10.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f7ed57cb6c0 1 -- 10.20.193.40:0/4076308284 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed00f9650 con 0x7f7ed005ee20 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.307+0000 7f70230886c0 1 -- start start 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f70230886c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f701c10f200 0x7f701c0666e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f70230886c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f701c115410 0x7f701c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f70230886c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f701c062940 0x7f701c062de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f70230886c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f701c063570 con 0x7f701c10f200 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f70230886c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f701c0636e0 con 0x7f701c115410 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f70230886c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f701c0ff090 con 0x7f701c062940 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f7013fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f701c115410 0x7f701c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f7013fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f701c115410 0x7f701c175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:50478/0 (socket says 10.20.193.40:50478) 2026-02-13T01:24:10.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f7013fff6c0 1 -- 10.20.193.40:0/250732736 learned_addr learned my addr 10.20.193.40:0/250732736 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:10.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f7eadffb6c0 1 -- 10.20.193.40:0/4076308284 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e94005310 con 0x7f7ed005ee20 2026-02-13T01:24:10.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f70215fe6c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f701c062940 0x7f701c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.309+0000 7f7020dfd6c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f701c10f200 0x7f701c0666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.309+0000 7f7013fff6c0 1 -- 10.20.193.40:0/250732736 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f701c062940 msgr2=0x7f701c062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.309+0000 7f7013fff6c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f701c062940 0x7f701c062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.309+0000 7f7013fff6c0 1 -- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f701c10f200 msgr2=0x7f701c0666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.309+0000 7f7013fff6c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f701c10f200 0x7f701c0666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.309+0000 7f7013fff6c0 1 -- 10.20.193.40:0/250732736 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c009590 con 0x7f701c115410 2026-02-13T01:24:10.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.309+0000 7f7020dfd6c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f701c10f200 0x7f701c0666e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:10.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.309+0000 7f7013fff6c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f701c115410 0x7f701c175cb0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70040023a0 tx=0x7f700402f6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b8005310 con 0x7f10f410f060 2026-02-13T01:24:10.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.308+0000 7f10d3fff6c0 1 -- 10.20.193.40:0/1305150433 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f10dc031030 con 0x7f10f410f060 2026-02-13T01:24:10.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.310+0000 7f7011ffb6c0 1 -- 10.20.193.40:0/250732736 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f700402fcd0 con 0x7f701c115410 2026-02-13T01:24:10.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.310+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70040094c0 con 0x7f701c115410 2026-02-13T01:24:10.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.310+0000 7f10d3fff6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f10c80b57c0 0x7f10c80d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.310+0000 7f10d3fff6c0 1 -- 10.20.193.40:0/1305150433 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f10dc12a200 con 0x7f10f410f060 2026-02-13T01:24:10.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.310+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f701c0ff6d0 con 0x7f701c115410 2026-02-13T01:24:10.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.310+0000 7f7011ffb6c0 1 -- 10.20.193.40:0/250732736 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7004031e40 con 0x7f701c115410 2026-02-13T01:24:10.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.310+0000 7f7011ffb6c0 1 -- 10.20.193.40:0/250732736 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7004007c60 con 0x7f701c115410 2026-02-13T01:24:10.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.311+0000 7f10f27fc6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f10c80b57c0 0x7f10c80d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.310+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe8005310 con 0x7f701c115410 2026-02-13T01:24:10.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.311+0000 7f10d3fff6c0 1 -- 10.20.193.40:0/1305150433 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f10dc0ecbe0 con 0x7f10f410f060 2026-02-13T01:24:10.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.312+0000 7f10f27fc6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f10c80b57c0 0x7f10c80d5c70 secure :-1 s=READY pgs=188 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10f41232c0 tx=0x7f10e8005cc0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.312+0000 7f7eaffff6c0 1 -- 10.20.193.40:0/4076308284 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7ec00043b0 con 0x7f7ed005ee20 2026-02-13T01:24:10.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.313+0000 7f7011ffb6c0 1 -- 10.20.193.40:0/250732736 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f70040026b0 con 0x7f701c115410 2026-02-13T01:24:10.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.314+0000 7f7eaffff6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ea40b5760 0x7f7ea40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.314+0000 7f7ece7fc6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ea40b5760 0x7f7ea40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.314+0000 7f7eaffff6c0 1 -- 10.20.193.40:0/4076308284 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f7ec00e3af0 con 0x7f7ed005ee20 2026-02-13T01:24:10.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.315+0000 7f7eaffff6c0 1 -- 10.20.193.40:0/4076308284 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7ec011c5e0 con 0x7f7ed005ee20 2026-02-13T01:24:10.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.315+0000 7f7ece7fc6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ea40b5760 0x7f7ea40d5c10 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ed005f6b0 tx=0x7f7ec4009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.315+0000 7f7011ffb6c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6fec0b5760 0x7f6fec0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:10.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.315+0000 7f7011ffb6c0 1 -- 10.20.193.40:0/250732736 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f7004107cb0 con 0x7f701c115410 2026-02-13T01:24:10.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.316+0000 7f7011ffb6c0 1 -- 10.20.193.40:0/250732736 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f70041081a0 con 0x7f701c115410 2026-02-13T01:24:10.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.316+0000 7f7020dfd6c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6fec0b5760 0x7f6fec0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:10.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.318+0000 7f7020dfd6c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6fec0b5760 0x7f6fec0d5c10 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f700c005b40 tx=0x7f700c009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.395+0000 7efc04ff96c0 1 -- 10.20.193.40:0/3692212676 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7efc1810f5d0 con 0x7efc1810a0f0 2026-02-13T01:24:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.396+0000 7efc06ffd6c0 1 -- 10.20.193.40:0/3692212676 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7efc140a7760 con 0x7efc1810a0f0 2026-02-13T01:24:10.398 INFO:teuthology.orchestra.run.trial040.stdout:266287972363 2026-02-13T01:24:10.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 -- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbf40b5760 msgr2=0x7efbf40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbf40b5760 0x7efbf40d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc080097f0 tx=0x7efc080023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 -- 10.20.193.40:0/3692212676 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efc1810a0f0 msgr2=0x7efc1810a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efc1810a0f0 0x7efc1810a590 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc1400a820 tx=0x7efc1400ce50 comp rx=0 tx=0).stop 2026-02-13T01:24:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 -- 10.20.193.40:0/3692212676 shutdown_connections 2026-02-13T01:24:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efbf40b5760 0x7efbf40d5c10 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efc1810a0f0 0x7efc1810a590 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc18115410 0x7efc18175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 --2- 10.20.193.40:0/3692212676 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efc1810f200 0x7efc1810ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.398+0000 7efc04ff96c0 1 -- 10.20.193.40:0/3692212676 >> 10.20.193.40:0/3692212676 conn(0x7efc180ecb00 msgr2=0x7efc1810d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.399+0000 7efc04ff96c0 1 -- 10.20.193.40:0/3692212676 shutdown_connections 2026-02-13T01:24:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.399+0000 7efc04ff96c0 1 -- 10.20.193.40:0/3692212676 wait complete. 2026-02-13T01:24:10.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.405+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff61c005890 con 0x7ff658115410 2026-02-13T01:24:10.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.405+0000 7ff63f7fe6c0 1 -- 10.20.193.40:0/3123763107 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff6400cd430 con 0x7ff658115410 2026-02-13T01:24:10.406 INFO:teuthology.orchestra.run.trial040.stdout:94489280535 2026-02-13T01:24:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff62c0b57b0 msgr2=0x7ff62c0d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff62c0b57b0 0x7ff62c0d5c60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff64c004750 tx=0x7ff64c009260 comp rx=0 tx=0).stop 2026-02-13T01:24:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff658115410 msgr2=0x7ff65811b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff658115410 0x7ff65811b160 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6400092b0 tx=0x7ff64002f7a0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 shutdown_connections 2026-02-13T01:24:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff62c0b57b0 0x7ff62c0d5c60 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff658120520 0x7ff6581209c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff658115410 0x7ff65811b160 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 --2- 10.20.193.40:0/3123763107 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff65810f200 0x7ff65811ac20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 >> 10.20.193.40:0/3123763107 conn(0x7ff6580ecb00 msgr2=0x7ff65810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 shutdown_connections 2026-02-13T01:24:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.407+0000 7ff65ca046c0 1 -- 10.20.193.40:0/3123763107 wait complete. 2026-02-13T01:24:10.423 INFO:teuthology.orchestra.run.trial040.stdout:68719476761 2026-02-13T01:24:10.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.417+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7eff3006edb0 con 0x7eff301198f0 2026-02-13T01:24:10.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.417+0000 7eff25ffb6c0 1 -- 10.20.193.40:0/49085133 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff200a9820 con 0x7eff301198f0 2026-02-13T01:24:10.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.421+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f10b80055c0 con 0x7f10f410f060 2026-02-13T01:24:10.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.421+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7eff000b5760 msgr2=0x7eff000d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.421+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7eff000b5760 0x7eff000d5c10 secure :-1 s=READY pgs=187 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff180098c0 tx=0x7eff180023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.421+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7eff301198f0 msgr2=0x7eff3011a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.421+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7eff301198f0 0x7eff3011a8f0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff20009490 tx=0x7eff2000bc50 comp rx=0 tx=0).stop 2026-02-13T01:24:10.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.422+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 shutdown_connections 2026-02-13T01:24:10.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.422+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7eff000b5760 0x7eff000d5c10 unknown :-1 s=CLOSED pgs=187 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.422+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7eff3015f270 0x7eff3015f710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.422+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7eff301198f0 0x7eff3011a8f0 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.422+0000 7eff3708f6c0 1 --2- 10.20.193.40:0/49085133 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7eff301137a0 0x7eff3011a3b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.422+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 >> 10.20.193.40:0/49085133 conn(0x7eff30060760 msgr2=0x7eff30115ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.422+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 shutdown_connections 2026-02-13T01:24:10.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.422+0000 7eff3708f6c0 1 -- 10.20.193.40:0/49085133 wait complete. 2026-02-13T01:24:10.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.425+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6fe8005890 con 0x7f701c115410 2026-02-13T01:24:10.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.425+0000 7f7011ffb6c0 1 -- 10.20.193.40:0/250732736 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70040ca640 con 0x7f701c115410 2026-02-13T01:24:10.428 INFO:teuthology.orchestra.run.trial040.stdout:34359738396 2026-02-13T01:24:10.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.427+0000 7f10d3fff6c0 1 -- 10.20.193.40:0/1305150433 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f10dc0efd00 con 0x7f10f410f060 2026-02-13T01:24:10.430 INFO:teuthology.orchestra.run.trial040.stdout:249108103180 2026-02-13T01:24:10.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6fec0b5760 msgr2=0x7f6fec0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6fec0b5760 0x7f6fec0d5c10 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f700c005b40 tx=0x7f700c009310 comp rx=0 tx=0).stop 2026-02-13T01:24:10.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f701c115410 msgr2=0x7f701c175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f701c115410 0x7f701c175cb0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70040023a0 tx=0x7f700402f6d0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 shutdown_connections 2026-02-13T01:24:10.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f6fec0b5760 0x7f6fec0d5c10 unknown :-1 s=CLOSED pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f701c062940 0x7f701c062de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f701c115410 0x7f701c175cb0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 --2- 10.20.193.40:0/250732736 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f701c10f200 0x7f701c0666e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 >> 10.20.193.40:0/250732736 conn(0x7f701c0ecb00 msgr2=0x7f701c113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 shutdown_connections 2026-02-13T01:24:10.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.429+0000 7f70230886c0 1 -- 10.20.193.40:0/250732736 wait complete. 2026-02-13T01:24:10.447 INFO:teuthology.orchestra.run.trial040.stdout:219043332110 2026-02-13T01:24:10.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.434+0000 7f7eadffb6c0 1 -- 10.20.193.40:0/4076308284 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f7e94005890 con 0x7f7ed005ee20 2026-02-13T01:24:10.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.436+0000 7f7eaffff6c0 1 -- 10.20.193.40:0/4076308284 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7ec00a6440 con 0x7f7ed005ee20 2026-02-13T01:24:10.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 -- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ea40b5760 msgr2=0x7f7ea40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ea40b5760 0x7f7ea40d5c10 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ed005f6b0 tx=0x7f7ec4009260 comp rx=0 tx=0).stop 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 -- 10.20.193.40:0/4076308284 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7ed005ee20 msgr2=0x7f7ed006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7ed005ee20 0x7f7ed006eb00 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ec000b710 tx=0x7f7ec000bbe0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 -- 10.20.193.40:0/4076308284 shutdown_connections 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ea40b5760 0x7f7ea40d5c10 unknown :-1 s=CLOSED pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7ed00f4fb0 0x7f7ed00f5420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ed0064720 0x7f7ed006f040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 --2- 10.20.193.40:0/4076308284 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7ed005ee20 0x7f7ed006eb00 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.440+0000 7f7eadffb6c0 1 -- 10.20.193.40:0/4076308284 >> 10.20.193.40:0/4076308284 conn(0x7f7ed00586e0 msgr2=0x7f7ed0063050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.441+0000 7f7eadffb6c0 1 -- 10.20.193.40:0/4076308284 shutdown_connections 2026-02-13T01:24:10.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.441+0000 7f7eadffb6c0 1 -- 10.20.193.40:0/4076308284 wait complete. 2026-02-13T01:24:10.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.443+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f10c80b57c0 msgr2=0x7f10c80d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.443+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f10c80b57c0 0x7f10c80d5c70 secure :-1 s=READY pgs=188 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10f41232c0 tx=0x7f10e8005cc0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.443+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 msgr2=0x7f10f411c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:10.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.443+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 0x7f10f411c980 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10dc02f210 tx=0x7f10dc005f40 comp rx=0 tx=0).stop 2026-02-13T01:24:10.450 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.448+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 shutdown_connections 2026-02-13T01:24:10.450 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.448+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f10c80b57c0 0x7f10c80d5c70 unknown :-1 s=CLOSED pgs=188 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.450 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.448+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f10f4122230 0x7f10f41226d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.450 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.448+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f10f4115270 0x7f10f411cec0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.450 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.448+0000 7f10f3fff6c0 1 --2- 10.20.193.40:0/1305150433 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f10f410f060 0x7f10f411c980 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:10.450 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.448+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 >> 10.20.193.40:0/1305150433 conn(0x7f10f40ec980 msgr2=0x7f10f410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:10.450 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.448+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 shutdown_connections 2026-02-13T01:24:10.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:10.448+0000 7f10f3fff6c0 1 -- 10.20.193.40:0/1305150433 wait complete. 2026-02-13T01:24:10.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:10 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3622871677' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:24:10.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:10 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1144000527' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:24:10.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:10 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2613751297' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:24:10.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:10 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/598508119' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:24:10.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:10 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1061196735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:24:10.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:10 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3622871677' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:24:10.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:10 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1144000527' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:24:10.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:10 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2613751297' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:24:10.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:10 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/598508119' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:24:10.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:10 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1061196735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:24:10.520 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972362 got 266287972363 for osd.10 2026-02-13T01:24:10.520 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.741 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280534 got 94489280535 for osd.3 2026-02-13T01:24:10.741 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.742 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103180 got 249108103180 for osd.9 2026-02-13T01:24:10.742 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.745 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332110 got 219043332110 for osd.8 2026-02-13T01:24:10.745 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.751 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738395 got 34359738396 for osd.0 2026-02-13T01:24:10.751 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.754 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476760 got 68719476761 for osd.2 2026-02-13T01:24:10.755 DEBUG:teuthology.parallel:result is None 2026-02-13T01:24:10.755 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T01:24:10.755 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:24:10.979 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:11.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.174+0000 7f7b39f376c0 1 -- 10.20.193.40:0/3284570987 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b34112ff0 msgr2=0x7f7b34173990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.174+0000 7f7b39f376c0 1 --2- 10.20.193.40:0/3284570987 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b34112ff0 0x7f7b34173990 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=4708213831610228883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b3000aa70 tx=0x7f7b3002fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.174+0000 7f7b39f376c0 1 -- 10.20.193.40:0/3284570987 shutdown_connections 2026-02-13T01:24:11.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.174+0000 7f7b39f376c0 1 --2- 10.20.193.40:0/3284570987 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b34112ff0 0x7f7b34173990 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=4708213831610228883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.174+0000 7f7b39f376c0 1 --2- 10.20.193.40:0/3284570987 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b3410d7d0 0x7f7b34112810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.174+0000 7f7b39f376c0 1 --2- 10.20.193.40:0/3284570987 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b3410cde0 0x7f7b3410d1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.174+0000 7f7b39f376c0 1 -- 10.20.193.40:0/3284570987 >> 10.20.193.40:0/3284570987 conn(0x7f7b340ea6a0 msgr2=0x7f7b3410aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:11.176 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.174+0000 7f7b39f376c0 1 -- 10.20.193.40:0/3284570987 shutdown_connections 2026-02-13T01:24:11.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.174+0000 7f7b39f376c0 1 -- 10.20.193.40:0/3284570987 wait complete. 2026-02-13T01:24:11.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.175+0000 7f7b39f376c0 1 Processor -- start 2026-02-13T01:24:11.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.175+0000 7f7b39f376c0 1 -- start start 2026-02-13T01:24:11.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.175+0000 7f7b39f376c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b3410cde0 0x7f7b340f46e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:11.178 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.175+0000 7f7b39f376c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b34112ff0 0x7f7b34173890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.175+0000 7f7b39f376c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b340f4d10 0x7f7b340f9fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.175+0000 7f7b39f376c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340f5400 con 0x7f7b34112ff0 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.175+0000 7f7b39f376c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340fa520 con 0x7f7b3410cde0 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.175+0000 7f7b39f376c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340fa6e0 con 0x7f7b340f4d10 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b2bfff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b34112ff0 0x7f7b34173890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b38f356c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b3410cde0 0x7f7b340f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b38f356c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b3410cde0 0x7f7b340f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:50492/0 (socket says 10.20.193.40:50492) 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b38f356c0 1 -- 10.20.193.40:0/3517100038 learned_addr learned my addr 10.20.193.40:0/3517100038 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b397366c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b340f4d10 0x7f7b340f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b2bfff6c0 1 -- 10.20.193.40:0/3517100038 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b340f4d10 msgr2=0x7f7b340f9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b2bfff6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b340f4d10 0x7f7b340f9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b2bfff6c0 1 -- 10.20.193.40:0/3517100038 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b3410cde0 msgr2=0x7f7b340f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b2bfff6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b3410cde0 0x7f7b340f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b2bfff6c0 1 -- 10.20.193.40:0/3517100038 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3000a660 con 0x7f7b34112ff0 2026-02-13T01:24:11.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b2bfff6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b34112ff0 0x7f7b34173890 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b1c004750 tx=0x7f7b1c00bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:11.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b29ffb6c0 1 -- 10.20.193.40:0/3517100038 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b1c0044a0 con 0x7f7b34112ff0 2026-02-13T01:24:11.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b29ffb6c0 1 -- 10.20.193.40:0/3517100038 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7b1c009030 con 0x7f7b34112ff0 2026-02-13T01:24:11.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b29ffb6c0 1 -- 10.20.193.40:0/3517100038 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b1c00ce30 con 0x7f7b34112ff0 2026-02-13T01:24:11.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b39f376c0 1 -- 10.20.193.40:0/3517100038 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b340fa9c0 con 0x7f7b34112ff0 2026-02-13T01:24:11.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.176+0000 7f7b39f376c0 1 -- 10.20.193.40:0/3517100038 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b340fae50 con 0x7f7b34112ff0 2026-02-13T01:24:11.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.177+0000 7f7b037fe6c0 1 -- 10.20.193.40:0/3517100038 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b3410e0b0 con 0x7f7b34112ff0 2026-02-13T01:24:11.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.179+0000 7f7b29ffb6c0 1 -- 10.20.193.40:0/3517100038 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7b1c00c370 con 0x7f7b34112ff0 2026-02-13T01:24:11.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.180+0000 7f7b29ffb6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b100b5760 0x7f7b100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:11.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.180+0000 7f7b29ffb6c0 1 -- 10.20.193.40:0/3517100038 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f7b1c0e38b0 con 0x7f7b34112ff0 2026-02-13T01:24:11.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.181+0000 7f7b29ffb6c0 1 -- 10.20.193.40:0/3517100038 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7b1c0e3da0 con 0x7f7b34112ff0 2026-02-13T01:24:11.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.181+0000 7f7b38f356c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b100b5760 0x7f7b100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:11.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.182+0000 7f7b38f356c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b100b5760 0x7f7b100d5c10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b24009240 tx=0x7f7b24009420 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:11.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.281+0000 7f7b037fe6c0 1 -- 10.20.193.40:0/3517100038 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b340fae50 con 0x7f7b100b5760 2026-02-13T01:24:11.283 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:11 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3692212676' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:24:11.283 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:11 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3123763107' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:24:11.283 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:11 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/49085133' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:24:11.283 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:11 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1305150433' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:24:11.283 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:11 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/250732736' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:24:11.283 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:11 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4076308284' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:24:11.283 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:11 trial040 ceph-mon[23046]: pgmap v185: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 8.9 KiB/s rd, 7.1 KiB/s wr, 11 op/s 2026-02-13T01:24:11.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.284+0000 7f7b29ffb6c0 1 -- 10.20.193.40:0/3517100038 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258823 (secure 0 0 0) 0x7f7b340fae50 con 0x7f7b100b5760 2026-02-13T01:24:11.288 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:11.290 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-13T01:24:11.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.286+0000 7f7b037fe6c0 1 -- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b100b5760 msgr2=0x7f7b100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.286+0000 7f7b037fe6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b100b5760 0x7f7b100d5c10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b24009240 tx=0x7f7b24009420 comp rx=0 tx=0).stop 2026-02-13T01:24:11.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.286+0000 7f7b037fe6c0 1 -- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b34112ff0 msgr2=0x7f7b34173890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.286+0000 7f7b037fe6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b34112ff0 0x7f7b34173890 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b1c004750 tx=0x7f7b1c00bae0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.287+0000 7f7b037fe6c0 1 -- 10.20.193.40:0/3517100038 shutdown_connections 2026-02-13T01:24:11.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.287+0000 7f7b037fe6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b100b5760 0x7f7b100d5c10 unknown :-1 s=CLOSED pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.287+0000 7f7b037fe6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b340f4d10 0x7f7b340f9fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.287+0000 7f7b037fe6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b34112ff0 0x7f7b34173890 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.287+0000 7f7b037fe6c0 1 --2- 10.20.193.40:0/3517100038 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b3410cde0 0x7f7b340f46e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.287+0000 7f7b037fe6c0 1 -- 10.20.193.40:0/3517100038 >> 10.20.193.40:0/3517100038 conn(0x7f7b340ea6a0 msgr2=0x7f7b3410b260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:11.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.287+0000 7f7b037fe6c0 1 -- 10.20.193.40:0/3517100038 shutdown_connections 2026-02-13T01:24:11.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.287+0000 7f7b037fe6c0 1 -- 10.20.193.40:0/3517100038 wait complete. 2026-02-13T01:24:11.394 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2026-02-13T01:24:10.691915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661679,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":211,"num_read_kb":219,"num_write":349,"num_write_kb":3838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":289,"ondisk_log_size":289,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335172,"kb_used_data":11604,"kb_used_omap":396,"kb_used_meta":322931,"kb_avail":8807703228,"statfs":{"total":9019431321600,"available":9019088105472,"internally_reserved":0,"allocated":11882496,"data_stored":6658293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":406175,"internal_metadata":330681697},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":59596,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":81,"num_read_kb":107,"num_write":61,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002342"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082432+0000","last_change":"2026-02-13T01:23:51.087785+0000","last_active":"2026-02-13T01:23:52.082432+0000","last_peered":"2026-02-13T01:23:52.082432+0000","last_clean":"2026-02-13T01:23:52.082432+0000","last_became_active":"2026-02-13T01:23:51.087666+0000","last_became_peered":"2026-02-13T01:23:51.087666+0000","last_unstale":"2026-02-13T01:23:52.082432+0000","last_undegraded":"2026-02-13T01:23:52.082432+0000","last_fullsized":"2026-02-13T01:23:52.082432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:35.585128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083500+0000","last_change":"2026-02-13T01:23:51.085295+0000","last_active":"2026-02-13T01:23:52.083500+0000","last_peered":"2026-02-13T01:23:52.083500+0000","last_clean":"2026-02-13T01:23:52.083500+0000","last_became_active":"2026-02-13T01:23:51.085131+0000","last_became_peered":"2026-02-13T01:23:51.085131+0000","last_unstale":"2026-02-13T01:23:52.083500+0000","last_undegraded":"2026-02-13T01:23:52.083500+0000","last_fullsized":"2026-02-13T01:23:52.083500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:18.129399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083128+0000","last_change":"2026-02-13T01:23:51.085354+0000","last_active":"2026-02-13T01:23:52.083128+0000","last_peered":"2026-02-13T01:23:52.083128+0000","last_clean":"2026-02-13T01:23:52.083128+0000","last_became_active":"2026-02-13T01:23:51.084953+0000","last_became_peered":"2026-02-13T01:23:51.084953+0000","last_unstale":"2026-02-13T01:23:52.083128+0000","last_undegraded":"2026-02-13T01:23:52.083128+0000","last_fullsized":"2026-02-13T01:23:52.083128+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:32.298388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311720+0000","last_change":"2026-02-13T01:23:51.077255+0000","last_active":"2026-02-13T01:23:52.311720+0000","last_peered":"2026-02-13T01:23:52.311720+0000","last_clean":"2026-02-13T01:23:52.311720+0000","last_became_active":"2026-02-13T01:23:51.076786+0000","last_became_peered":"2026-02-13T01:23:51.076786+0000","last_unstale":"2026-02-13T01:23:52.311720+0000","last_undegraded":"2026-02-13T01:23:52.311720+0000","last_fullsized":"2026-02-13T01:23:52.311720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:25.514019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312471+0000","last_change":"2026-02-13T01:23:51.078791+0000","last_active":"2026-02-13T01:23:52.312471+0000","last_peered":"2026-02-13T01:23:52.312471+0000","last_clean":"2026-02-13T01:23:52.312471+0000","last_became_active":"2026-02-13T01:23:51.078655+0000","last_became_peered":"2026-02-13T01:23:51.078655+0000","last_unstale":"2026-02-13T01:23:52.312471+0000","last_undegraded":"2026-02-13T01:23:52.312471+0000","last_fullsized":"2026-02-13T01:23:52.312471+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:39:11.299004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081309+0000","last_change":"2026-02-13T01:23:51.078732+0000","last_active":"2026-02-13T01:23:52.081309+0000","last_peered":"2026-02-13T01:23:52.081309+0000","last_clean":"2026-02-13T01:23:52.081309+0000","last_became_active":"2026-02-13T01:23:51.078623+0000","last_became_peered":"2026-02-13T01:23:51.078623+0000","last_unstale":"2026-02-13T01:23:52.081309+0000","last_undegraded":"2026-02-13T01:23:52.081309+0000","last_fullsized":"2026-02-13T01:23:52.081309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:44.150512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957653+0000","last_change":"2026-02-13T01:23:51.079852+0000","last_active":"2026-02-13T01:23:52.957653+0000","last_peered":"2026-02-13T01:23:52.957653+0000","last_clean":"2026-02-13T01:23:52.957653+0000","last_became_active":"2026-02-13T01:23:51.079722+0000","last_became_peered":"2026-02-13T01:23:51.079722+0000","last_unstale":"2026-02-13T01:23:52.957653+0000","last_undegraded":"2026-02-13T01:23:52.957653+0000","last_fullsized":"2026-02-13T01:23:52.957653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:05:57.521391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082415+0000","last_change":"2026-02-13T01:23:51.080431+0000","last_active":"2026-02-13T01:23:52.082415+0000","last_peered":"2026-02-13T01:23:52.082415+0000","last_clean":"2026-02-13T01:23:52.082415+0000","last_became_active":"2026-02-13T01:23:51.080137+0000","last_became_peered":"2026-02-13T01:23:51.080137+0000","last_unstale":"2026-02-13T01:23:52.082415+0000","last_undegraded":"2026-02-13T01:23:52.082415+0000","last_fullsized":"2026-02-13T01:23:52.082415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:24.824142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311585+0000","last_change":"2026-02-13T01:23:51.076636+0000","last_active":"2026-02-13T01:23:52.311585+0000","last_peered":"2026-02-13T01:23:52.311585+0000","last_clean":"2026-02-13T01:23:52.311585+0000","last_became_active":"2026-02-13T01:23:51.076457+0000","last_became_peered":"2026-02-13T01:23:51.076457+0000","last_unstale":"2026-02-13T01:23:52.311585+0000","last_undegraded":"2026-02-13T01:23:52.311585+0000","last_fullsized":"2026-02-13T01:23:52.311585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:25:35.580381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081654+0000","last_change":"2026-02-13T01:23:51.077042+0000","last_active":"2026-02-13T01:23:52.081654+0000","last_peered":"2026-02-13T01:23:52.081654+0000","last_clean":"2026-02-13T01:23:52.081654+0000","last_became_active":"2026-02-13T01:23:51.076925+0000","last_became_peered":"2026-02-13T01:23:51.076925+0000","last_unstale":"2026-02-13T01:23:52.081654+0000","last_undegraded":"2026-02-13T01:23:52.081654+0000","last_fullsized":"2026-02-13T01:23:52.081654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:24:36.245078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958059+0000","last_change":"2026-02-13T01:23:51.076945+0000","last_active":"2026-02-13T01:23:52.958059+0000","last_peered":"2026-02-13T01:23:52.958059+0000","last_clean":"2026-02-13T01:23:52.958059+0000","last_became_active":"2026-02-13T01:23:51.076801+0000","last_became_peered":"2026-02-13T01:23:51.076801+0000","last_unstale":"2026-02-13T01:23:52.958059+0000","last_undegraded":"2026-02-13T01:23:52.958059+0000","last_fullsized":"2026-02-13T01:23:52.958059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:14:06.277449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311818+0000","last_change":"2026-02-13T01:23:51.077720+0000","last_active":"2026-02-13T01:23:52.311818+0000","last_peered":"2026-02-13T01:23:52.311818+0000","last_clean":"2026-02-13T01:23:52.311818+0000","last_became_active":"2026-02-13T01:23:51.077217+0000","last_became_peered":"2026-02-13T01:23:51.077217+0000","last_unstale":"2026-02-13T01:23:52.311818+0000","last_undegraded":"2026-02-13T01:23:52.311818+0000","last_fullsized":"2026-02-13T01:23:52.311818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:33.011072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084544+0000","last_change":"2026-02-13T01:23:51.078177+0000","last_active":"2026-02-13T01:23:52.084544+0000","last_peered":"2026-02-13T01:23:52.084544+0000","last_clean":"2026-02-13T01:23:52.084544+0000","last_became_active":"2026-02-13T01:23:51.078110+0000","last_became_peered":"2026-02-13T01:23:51.078110+0000","last_unstale":"2026-02-13T01:23:52.084544+0000","last_undegraded":"2026-02-13T01:23:52.084544+0000","last_fullsized":"2026-02-13T01:23:52.084544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:59.357633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082814+0000","last_change":"2026-02-13T01:23:51.086034+0000","last_active":"2026-02-13T01:23:52.082814+0000","last_peered":"2026-02-13T01:23:52.082814+0000","last_clean":"2026-02-13T01:23:52.082814+0000","last_became_active":"2026-02-13T01:23:51.085782+0000","last_became_peered":"2026-02-13T01:23:51.085782+0000","last_unstale":"2026-02-13T01:23:52.082814+0000","last_undegraded":"2026-02-13T01:23:52.082814+0000","last_fullsized":"2026-02-13T01:23:52.082814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:28:34.185905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082761+0000","last_change":"2026-02-13T01:23:51.082750+0000","last_active":"2026-02-13T01:23:52.082761+0000","last_peered":"2026-02-13T01:23:52.082761+0000","last_clean":"2026-02-13T01:23:52.082761+0000","last_became_active":"2026-02-13T01:23:51.082533+0000","last_became_peered":"2026-02-13T01:23:51.082533+0000","last_unstale":"2026-02-13T01:23:52.082761+0000","last_undegraded":"2026-02-13T01:23:52.082761+0000","last_fullsized":"2026-02-13T01:23:52.082761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:10:33.600010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.310928+0000","last_change":"2026-02-13T01:23:51.083431+0000","last_active":"2026-02-13T01:23:52.310928+0000","last_peered":"2026-02-13T01:23:52.310928+0000","last_clean":"2026-02-13T01:23:52.310928+0000","last_became_active":"2026-02-13T01:23:51.083297+0000","last_became_peered":"2026-02-13T01:23:51.083297+0000","last_unstale":"2026-02-13T01:23:52.310928+0000","last_undegraded":"2026-02-13T01:23:52.310928+0000","last_fullsized":"2026-02-13T01:23:52.310928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:45:36.970802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082486+0000","last_change":"2026-02-13T01:23:51.087754+0000","last_active":"2026-02-13T01:23:52.082486+0000","last_peered":"2026-02-13T01:23:52.082486+0000","last_clean":"2026-02-13T01:23:52.082486+0000","last_became_active":"2026-02-13T01:23:51.087606+0000","last_became_peered":"2026-02-13T01:23:51.087606+0000","last_unstale":"2026-02-13T01:23:52.082486+0000","last_undegraded":"2026-02-13T01:23:52.082486+0000","last_fullsized":"2026-02-13T01:23:52.082486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:15.160137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084350+0000","last_change":"2026-02-13T01:23:51.082589+0000","last_active":"2026-02-13T01:23:52.084350+0000","last_peered":"2026-02-13T01:23:52.084350+0000","last_clean":"2026-02-13T01:23:52.084350+0000","last_became_active":"2026-02-13T01:23:51.081937+0000","last_became_peered":"2026-02-13T01:23:51.081937+0000","last_unstale":"2026-02-13T01:23:52.084350+0000","last_undegraded":"2026-02-13T01:23:52.084350+0000","last_fullsized":"2026-02-13T01:23:52.084350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:23:55.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312722+0000","last_change":"2026-02-13T01:23:51.083199+0000","last_active":"2026-02-13T01:23:52.312722+0000","last_peered":"2026-02-13T01:23:52.312722+0000","last_clean":"2026-02-13T01:23:52.312722+0000","last_became_active":"2026-02-13T01:23:51.083082+0000","last_became_peered":"2026-02-13T01:23:51.083082+0000","last_unstale":"2026-02-13T01:23:52.312722+0000","last_undegraded":"2026-02-13T01:23:52.312722+0000","last_fullsized":"2026-02-13T01:23:52.312722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:40:27.940964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082074+0000","last_change":"2026-02-13T01:23:51.078089+0000","last_active":"2026-02-13T01:23:52.082074+0000","last_peered":"2026-02-13T01:23:52.082074+0000","last_clean":"2026-02-13T01:23:52.082074+0000","last_became_active":"2026-02-13T01:23:51.077949+0000","last_became_peered":"2026-02-13T01:23:51.077949+0000","last_unstale":"2026-02-13T01:23:52.082074+0000","last_undegraded":"2026-02-13T01:23:52.082074+0000","last_fullsized":"2026-02-13T01:23:52.082074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:49:31.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084637+0000","last_change":"2026-02-13T01:23:51.087902+0000","last_active":"2026-02-13T01:23:52.084637+0000","last_peered":"2026-02-13T01:23:52.084637+0000","last_clean":"2026-02-13T01:23:52.084637+0000","last_became_active":"2026-02-13T01:23:51.087588+0000","last_became_peered":"2026-02-13T01:23:51.087588+0000","last_unstale":"2026-02-13T01:23:52.084637+0000","last_undegraded":"2026-02-13T01:23:52.084637+0000","last_fullsized":"2026-02-13T01:23:52.084637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:59:18.831776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311145+0000","last_change":"2026-02-13T01:23:51.082383+0000","last_active":"2026-02-13T01:23:52.311145+0000","last_peered":"2026-02-13T01:23:52.311145+0000","last_clean":"2026-02-13T01:23:52.311145+0000","last_became_active":"2026-02-13T01:23:51.082213+0000","last_became_peered":"2026-02-13T01:23:51.082213+0000","last_unstale":"2026-02-13T01:23:52.311145+0000","last_undegraded":"2026-02-13T01:23:52.311145+0000","last_fullsized":"2026-02-13T01:23:52.311145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:31:53.038095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082509+0000","last_change":"2026-02-13T01:23:51.084995+0000","last_active":"2026-02-13T01:23:52.082509+0000","last_peered":"2026-02-13T01:23:52.082509+0000","last_clean":"2026-02-13T01:23:52.082509+0000","last_became_active":"2026-02-13T01:23:51.084099+0000","last_became_peered":"2026-02-13T01:23:51.084099+0000","last_unstale":"2026-02-13T01:23:52.082509+0000","last_undegraded":"2026-02-13T01:23:52.082509+0000","last_fullsized":"2026-02-13T01:23:52.082509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:28:13.169004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081986+0000","last_change":"2026-02-13T01:23:51.079945+0000","last_active":"2026-02-13T01:23:52.081986+0000","last_peered":"2026-02-13T01:23:52.081986+0000","last_clean":"2026-02-13T01:23:52.081986+0000","last_became_active":"2026-02-13T01:23:51.079769+0000","last_became_peered":"2026-02-13T01:23:51.079769+0000","last_unstale":"2026-02-13T01:23:52.081986+0000","last_undegraded":"2026-02-13T01:23:52.081986+0000","last_fullsized":"2026-02-13T01:23:52.081986+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:35:23.092307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082900+0000","last_change":"2026-02-13T01:23:51.083623+0000","last_active":"2026-02-13T01:23:52.082900+0000","last_peered":"2026-02-13T01:23:52.082900+0000","last_clean":"2026-02-13T01:23:52.082900+0000","last_became_active":"2026-02-13T01:23:51.080812+0000","last_became_peered":"2026-02-13T01:23:51.080812+0000","last_unstale":"2026-02-13T01:23:52.082900+0000","last_undegraded":"2026-02-13T01:23:52.082900+0000","last_fullsized":"2026-02-13T01:23:52.082900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:11.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312793+0000","last_change":"2026-02-13T01:23:51.077158+0000","last_active":"2026-02-13T01:23:52.312793+0000","last_peered":"2026-02-13T01:23:52.312793+0000","last_clean":"2026-02-13T01:23:52.312793+0000","last_became_active":"2026-02-13T01:23:51.077028+0000","last_became_peered":"2026-02-13T01:23:51.077028+0000","last_unstale":"2026-02-13T01:23:52.312793+0000","last_undegraded":"2026-02-13T01:23:52.312793+0000","last_fullsized":"2026-02-13T01:23:52.312793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:58:04.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082315+0000","last_change":"2026-02-13T01:23:51.077585+0000","last_active":"2026-02-13T01:23:52.082315+0000","last_peered":"2026-02-13T01:23:52.082315+0000","last_clean":"2026-02-13T01:23:52.082315+0000","last_became_active":"2026-02-13T01:23:51.077411+0000","last_became_peered":"2026-02-13T01:23:51.077411+0000","last_unstale":"2026-02-13T01:23:52.082315+0000","last_undegraded":"2026-02-13T01:23:52.082315+0000","last_fullsized":"2026-02-13T01:23:52.082315+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:08.469350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084548+0000","last_change":"2026-02-13T01:23:51.087500+0000","last_active":"2026-02-13T01:23:52.084548+0000","last_peered":"2026-02-13T01:23:52.084548+0000","last_clean":"2026-02-13T01:23:52.084548+0000","last_became_active":"2026-02-13T01:23:51.087400+0000","last_became_peered":"2026-02-13T01:23:51.087400+0000","last_unstale":"2026-02-13T01:23:52.084548+0000","last_undegraded":"2026-02-13T01:23:52.084548+0000","last_fullsized":"2026-02-13T01:23:52.084548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:39.858050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083032+0000","last_change":"2026-02-13T01:23:51.086351+0000","last_active":"2026-02-13T01:23:52.083032+0000","last_peered":"2026-02-13T01:23:52.083032+0000","last_clean":"2026-02-13T01:23:52.083032+0000","last_became_active":"2026-02-13T01:23:51.086196+0000","last_became_peered":"2026-02-13T01:23:51.086196+0000","last_unstale":"2026-02-13T01:23:52.083032+0000","last_undegraded":"2026-02-13T01:23:52.083032+0000","last_fullsized":"2026-02-13T01:23:52.083032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:20:51.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312466+0000","last_change":"2026-02-13T01:23:51.086663+0000","last_active":"2026-02-13T01:23:52.312466+0000","last_peered":"2026-02-13T01:23:52.312466+0000","last_clean":"2026-02-13T01:23:52.312466+0000","last_became_active":"2026-02-13T01:23:51.086549+0000","last_became_peered":"2026-02-13T01:23:51.086549+0000","last_unstale":"2026-02-13T01:23:52.312466+0000","last_undegraded":"2026-02-13T01:23:52.312466+0000","last_fullsized":"2026-02-13T01:23:52.312466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:08.297213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312479+0000","last_change":"2026-02-13T01:23:51.079493+0000","last_active":"2026-02-13T01:23:52.312479+0000","last_peered":"2026-02-13T01:23:52.312479+0000","last_clean":"2026-02-13T01:23:52.312479+0000","last_became_active":"2026-02-13T01:23:51.079217+0000","last_became_peered":"2026-02-13T01:23:51.079217+0000","last_unstale":"2026-02-13T01:23:52.312479+0000","last_undegraded":"2026-02-13T01:23:52.312479+0000","last_fullsized":"2026-02-13T01:23:52.312479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:30:24.298223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081960+0000","last_change":"2026-02-13T01:23:51.079378+0000","last_active":"2026-02-13T01:23:52.081960+0000","last_peered":"2026-02-13T01:23:52.081960+0000","last_clean":"2026-02-13T01:23:52.081960+0000","last_became_active":"2026-02-13T01:23:51.079184+0000","last_became_peered":"2026-02-13T01:23:51.079184+0000","last_unstale":"2026-02-13T01:23:52.081960+0000","last_undegraded":"2026-02-13T01:23:52.081960+0000","last_fullsized":"2026-02-13T01:23:52.081960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:28:10.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312491+0000","last_change":"2026-02-13T01:23:51.079975+0000","last_active":"2026-02-13T01:23:52.312491+0000","last_peered":"2026-02-13T01:23:52.312491+0000","last_clean":"2026-02-13T01:23:52.312491+0000","last_became_active":"2026-02-13T01:23:51.079841+0000","last_became_peered":"2026-02-13T01:23:51.079841+0000","last_unstale":"2026-02-13T01:23:52.312491+0000","last_undegraded":"2026-02-13T01:23:52.312491+0000","last_fullsized":"2026-02-13T01:23:52.312491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:28.275600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:07.117291+0000","last_change":"2026-02-13T01:23:50.314202+0000","last_active":"2026-02-13T01:24:07.117291+0000","last_peered":"2026-02-13T01:24:07.117291+0000","last_clean":"2026-02-13T01:24:07.117291+0000","last_became_active":"2026-02-13T01:23:50.313965+0000","last_became_peered":"2026-02-13T01:23:50.313965+0000","last_unstale":"2026-02-13T01:24:07.117291+0000","last_undegraded":"2026-02-13T01:24:07.117291+0000","last_fullsized":"2026-02-13T01:24:07.117291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:58:16.283974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082398+0000","last_change":"2026-02-13T01:23:51.083970+0000","last_active":"2026-02-13T01:23:52.082398+0000","last_peered":"2026-02-13T01:23:52.082398+0000","last_clean":"2026-02-13T01:23:52.082398+0000","last_became_active":"2026-02-13T01:23:51.083823+0000","last_became_peered":"2026-02-13T01:23:51.083823+0000","last_unstale":"2026-02-13T01:23:52.082398+0000","last_undegraded":"2026-02-13T01:23:52.082398+0000","last_fullsized":"2026-02-13T01:23:52.082398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:18:40.333939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103253+0000","last_change":"2026-02-13T01:23:50.315973+0000","last_active":"2026-02-13T01:23:56.103253+0000","last_peered":"2026-02-13T01:23:56.103253+0000","last_clean":"2026-02-13T01:23:56.103253+0000","last_became_active":"2026-02-13T01:23:50.315798+0000","last_became_peered":"2026-02-13T01:23:50.315798+0000","last_unstale":"2026-02-13T01:23:56.103253+0000","last_undegraded":"2026-02-13T01:23:56.103253+0000","last_fullsized":"2026-02-13T01:23:56.103253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:40.079951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.108656+0000","last_change":"2026-02-13T01:23:50.321711+0000","last_active":"2026-02-13T01:23:56.108656+0000","last_peered":"2026-02-13T01:23:56.108656+0000","last_clean":"2026-02-13T01:23:56.108656+0000","last_became_active":"2026-02-13T01:23:50.320547+0000","last_became_peered":"2026-02-13T01:23:50.320547+0000","last_unstale":"2026-02-13T01:23:56.108656+0000","last_undegraded":"2026-02-13T01:23:56.108656+0000","last_fullsized":"2026-02-13T01:23:56.108656+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:07.279129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084082+0000","last_change":"2026-02-13T01:23:51.079484+0000","last_active":"2026-02-13T01:23:52.084082+0000","last_peered":"2026-02-13T01:23:52.084082+0000","last_clean":"2026-02-13T01:23:52.084082+0000","last_became_active":"2026-02-13T01:23:51.079364+0000","last_became_peered":"2026-02-13T01:23:51.079364+0000","last_unstale":"2026-02-13T01:23:52.084082+0000","last_undegraded":"2026-02-13T01:23:52.084082+0000","last_fullsized":"2026-02-13T01:23:52.084082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:46:25.508752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:53.519478+0000","last_change":"2026-02-13T01:23:50.313889+0000","last_active":"2026-02-13T01:23:53.519478+0000","last_peered":"2026-02-13T01:23:53.519478+0000","last_clean":"2026-02-13T01:23:53.519478+0000","last_became_active":"2026-02-13T01:23:50.313686+0000","last_became_peered":"2026-02-13T01:23:50.313686+0000","last_unstale":"2026-02-13T01:23:53.519478+0000","last_undegraded":"2026-02-13T01:23:53.519478+0000","last_fullsized":"2026-02-13T01:23:53.519478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:06.306071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084282+0000","last_change":"2026-02-13T01:23:51.085261+0000","last_active":"2026-02-13T01:23:52.084282+0000","last_peered":"2026-02-13T01:23:52.084282+0000","last_clean":"2026-02-13T01:23:52.084282+0000","last_became_active":"2026-02-13T01:23:51.085174+0000","last_became_peered":"2026-02-13T01:23:51.085174+0000","last_unstale":"2026-02-13T01:23:52.084282+0000","last_undegraded":"2026-02-13T01:23:52.084282+0000","last_fullsized":"2026-02-13T01:23:52.084282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:22:06.653604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:06.115569+0000","last_change":"2026-02-13T01:23:50.319556+0000","last_active":"2026-02-13T01:24:06.115569+0000","last_peered":"2026-02-13T01:24:06.115569+0000","last_clean":"2026-02-13T01:24:06.115569+0000","last_became_active":"2026-02-13T01:23:50.319416+0000","last_became_peered":"2026-02-13T01:23:50.319416+0000","last_unstale":"2026-02-13T01:24:06.115569+0000","last_undegraded":"2026-02-13T01:24:06.115569+0000","last_fullsized":"2026-02-13T01:24:06.115569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:21:13.508452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311504+0000","last_change":"2026-02-13T01:23:51.080630+0000","last_active":"2026-02-13T01:23:52.311504+0000","last_peered":"2026-02-13T01:23:52.311504+0000","last_clean":"2026-02-13T01:23:52.311504+0000","last_became_active":"2026-02-13T01:23:51.080523+0000","last_became_peered":"2026-02-13T01:23:51.080523+0000","last_unstale":"2026-02-13T01:23:52.311504+0000","last_undegraded":"2026-02-13T01:23:52.311504+0000","last_fullsized":"2026-02-13T01:23:52.311504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:31:27.515871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.099151+0000","last_change":"2026-02-13T01:23:50.313353+0000","last_active":"2026-02-13T01:23:55.099151+0000","last_peered":"2026-02-13T01:23:55.099151+0000","last_clean":"2026-02-13T01:23:55.099151+0000","last_became_active":"2026-02-13T01:23:50.312960+0000","last_became_peered":"2026-02-13T01:23:50.312960+0000","last_unstale":"2026-02-13T01:23:55.099151+0000","last_undegraded":"2026-02-13T01:23:55.099151+0000","last_fullsized":"2026-02-13T01:23:55.099151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:17.457348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083218+0000","last_change":"2026-02-13T01:23:51.085556+0000","last_active":"2026-02-13T01:23:52.083218+0000","last_peered":"2026-02-13T01:23:52.083218+0000","last_clean":"2026-02-13T01:23:52.083218+0000","last_became_active":"2026-02-13T01:23:51.084737+0000","last_became_peered":"2026-02-13T01:23:51.084737+0000","last_unstale":"2026-02-13T01:23:52.083218+0000","last_undegraded":"2026-02-13T01:23:52.083218+0000","last_fullsized":"2026-02-13T01:23:52.083218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:34.732291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.102259+0000","last_change":"2026-02-13T01:23:50.314013+0000","last_active":"2026-02-13T01:23:55.102259+0000","last_peered":"2026-02-13T01:23:55.102259+0000","last_clean":"2026-02-13T01:23:55.102259+0000","last_became_active":"2026-02-13T01:23:50.313750+0000","last_became_peered":"2026-02-13T01:23:50.313750+0000","last_unstale":"2026-02-13T01:23:55.102259+0000","last_undegraded":"2026-02-13T01:23:55.102259+0000","last_fullsized":"2026-02-13T01:23:55.102259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:11.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311298+0000","last_change":"2026-02-13T01:23:51.078331+0000","last_active":"2026-02-13T01:23:52.311298+0000","last_peered":"2026-02-13T01:23:52.311298+0000","last_clean":"2026-02-13T01:23:52.311298+0000","last_became_active":"2026-02-13T01:23:51.078107+0000","last_became_peered":"2026-02-13T01:23:51.078107+0000","last_unstale":"2026-02-13T01:23:52.311298+0000","last_undegraded":"2026-02-13T01:23:52.311298+0000","last_fullsized":"2026-02-13T01:23:52.311298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:01.797388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'26","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:07.117333+0000","last_change":"2026-02-13T01:23:50.312858+0000","last_active":"2026-02-13T01:24:07.117333+0000","last_peered":"2026-02-13T01:24:07.117333+0000","last_clean":"2026-02-13T01:24:07.117333+0000","last_became_active":"2026-02-13T01:23:50.312641+0000","last_became_peered":"2026-02-13T01:23:50.312641+0000","last_unstale":"2026-02-13T01:24:07.117333+0000","last_undegraded":"2026-02-13T01:24:07.117333+0000","last_fullsized":"2026-02-13T01:24:07.117333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:14.572231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66991,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":78,"num_write":27,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312665+0000","last_change":"2026-02-13T01:23:51.077407+0000","last_active":"2026-02-13T01:23:52.312665+0000","last_peered":"2026-02-13T01:23:52.312665+0000","last_clean":"2026-02-13T01:23:52.312665+0000","last_became_active":"2026-02-13T01:23:51.077180+0000","last_became_peered":"2026-02-13T01:23:51.077180+0000","last_unstale":"2026-02-13T01:23:52.312665+0000","last_undegraded":"2026-02-13T01:23:52.312665+0000","last_fullsized":"2026-02-13T01:23:52.312665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:40:00.558376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104764+0000","last_change":"2026-02-13T01:23:50.313114+0000","last_active":"2026-02-13T01:23:56.104764+0000","last_peered":"2026-02-13T01:23:56.104764+0000","last_clean":"2026-02-13T01:23:56.104764+0000","last_became_active":"2026-02-13T01:23:50.312955+0000","last_became_peered":"2026-02-13T01:23:50.312955+0000","last_unstale":"2026-02-13T01:23:56.104764+0000","last_undegraded":"2026-02-13T01:23:56.104764+0000","last_fullsized":"2026-02-13T01:23:56.104764+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:48:28.664538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084295+0000","last_change":"2026-02-13T01:23:51.087820+0000","last_active":"2026-02-13T01:23:52.084295+0000","last_peered":"2026-02-13T01:23:52.084295+0000","last_clean":"2026-02-13T01:23:52.084295+0000","last_became_active":"2026-02-13T01:23:51.087642+0000","last_became_peered":"2026-02-13T01:23:51.087642+0000","last_unstale":"2026-02-13T01:23:52.084295+0000","last_undegraded":"2026-02-13T01:23:52.084295+0000","last_fullsized":"2026-02-13T01:23:52.084295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:53:35.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.101071+0000","last_change":"2026-02-13T01:23:50.317064+0000","last_active":"2026-02-13T01:23:55.101071+0000","last_peered":"2026-02-13T01:23:55.101071+0000","last_clean":"2026-02-13T01:23:55.101071+0000","last_became_active":"2026-02-13T01:23:50.316871+0000","last_became_peered":"2026-02-13T01:23:50.316871+0000","last_unstale":"2026-02-13T01:23:55.101071+0000","last_undegraded":"2026-02-13T01:23:55.101071+0000","last_fullsized":"2026-02-13T01:23:55.101071+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:16.140406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957948+0000","last_change":"2026-02-13T01:23:51.076041+0000","last_active":"2026-02-13T01:23:52.957948+0000","last_peered":"2026-02-13T01:23:52.957948+0000","last_clean":"2026-02-13T01:23:52.957948+0000","last_became_active":"2026-02-13T01:23:51.075750+0000","last_became_peered":"2026-02-13T01:23:51.075750+0000","last_unstale":"2026-02-13T01:23:52.957948+0000","last_undegraded":"2026-02-13T01:23:52.957948+0000","last_fullsized":"2026-02-13T01:23:52.957948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:37:15.723754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:09.124761+0000","last_change":"2026-02-13T01:23:50.312631+0000","last_active":"2026-02-13T01:24:09.124761+0000","last_peered":"2026-02-13T01:24:09.124761+0000","last_clean":"2026-02-13T01:24:09.124761+0000","last_became_active":"2026-02-13T01:23:50.312445+0000","last_became_peered":"2026-02-13T01:23:50.312445+0000","last_unstale":"2026-02-13T01:24:09.124761+0000","last_undegraded":"2026-02-13T01:24:09.124761+0000","last_fullsized":"2026-02-13T01:24:09.124761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:40.527470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957625+0000","last_change":"2026-02-13T01:23:51.078230+0000","last_active":"2026-02-13T01:23:52.957625+0000","last_peered":"2026-02-13T01:23:52.957625+0000","last_clean":"2026-02-13T01:23:52.957625+0000","last_became_active":"2026-02-13T01:23:51.078113+0000","last_became_peered":"2026-02-13T01:23:51.078113+0000","last_unstale":"2026-02-13T01:23:52.957625+0000","last_undegraded":"2026-02-13T01:23:52.957625+0000","last_fullsized":"2026-02-13T01:23:52.957625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:09.649368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104938+0000","last_change":"2026-02-13T01:23:50.314144+0000","last_active":"2026-02-13T01:23:56.104938+0000","last_peered":"2026-02-13T01:23:56.104938+0000","last_clean":"2026-02-13T01:23:56.104938+0000","last_became_active":"2026-02-13T01:23:50.313897+0000","last_became_peered":"2026-02-13T01:23:50.313897+0000","last_unstale":"2026-02-13T01:23:56.104938+0000","last_undegraded":"2026-02-13T01:23:56.104938+0000","last_fullsized":"2026-02-13T01:23:56.104938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:36:50.923122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082071+0000","last_change":"2026-02-13T01:23:51.078401+0000","last_active":"2026-02-13T01:23:52.082071+0000","last_peered":"2026-02-13T01:23:52.082071+0000","last_clean":"2026-02-13T01:23:52.082071+0000","last_became_active":"2026-02-13T01:23:51.078113+0000","last_became_peered":"2026-02-13T01:23:51.078113+0000","last_unstale":"2026-02-13T01:23:52.082071+0000","last_undegraded":"2026-02-13T01:23:52.082071+0000","last_fullsized":"2026-02-13T01:23:52.082071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:38:58.059781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.108405+0000","last_change":"2026-02-13T01:23:50.311883+0000","last_active":"2026-02-13T01:23:57.108405+0000","last_peered":"2026-02-13T01:23:57.108405+0000","last_clean":"2026-02-13T01:23:57.108405+0000","last_became_active":"2026-02-13T01:23:50.311677+0000","last_became_peered":"2026-02-13T01:23:50.311677+0000","last_unstale":"2026-02-13T01:23:57.108405+0000","last_undegraded":"2026-02-13T01:23:57.108405+0000","last_fullsized":"2026-02-13T01:23:57.108405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:03:41.688088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082293+0000","last_change":"2026-02-13T01:23:51.077302+0000","last_active":"2026-02-13T01:23:52.082293+0000","last_peered":"2026-02-13T01:23:52.082293+0000","last_clean":"2026-02-13T01:23:52.082293+0000","last_became_active":"2026-02-13T01:23:51.077062+0000","last_became_peered":"2026-02-13T01:23:51.077062+0000","last_unstale":"2026-02-13T01:23:52.082293+0000","last_undegraded":"2026-02-13T01:23:52.082293+0000","last_fullsized":"2026-02-13T01:23:52.082293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:29:19.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084451+0000","last_change":"2026-02-13T01:23:50.318138+0000","last_active":"2026-02-13T01:23:52.084451+0000","last_peered":"2026-02-13T01:23:52.084451+0000","last_clean":"2026-02-13T01:23:52.084451+0000","last_became_active":"2026-02-13T01:23:50.318046+0000","last_became_peered":"2026-02-13T01:23:50.318046+0000","last_unstale":"2026-02-13T01:23:52.084451+0000","last_undegraded":"2026-02-13T01:23:52.084451+0000","last_fullsized":"2026-02-13T01:23:52.084451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:08:08.981534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958104+0000","last_change":"2026-02-13T01:23:51.076583+0000","last_active":"2026-02-13T01:23:52.958104+0000","last_peered":"2026-02-13T01:23:52.958104+0000","last_clean":"2026-02-13T01:23:52.958104+0000","last_became_active":"2026-02-13T01:23:51.076410+0000","last_became_peered":"2026-02-13T01:23:51.076410+0000","last_unstale":"2026-02-13T01:23:52.958104+0000","last_undegraded":"2026-02-13T01:23:52.958104+0000","last_fullsized":"2026-02-13T01:23:52.958104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:32.267216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:53.519536+0000","last_change":"2026-02-13T01:23:50.314790+0000","last_active":"2026-02-13T01:23:53.519536+0000","last_peered":"2026-02-13T01:23:53.519536+0000","last_clean":"2026-02-13T01:23:53.519536+0000","last_became_active":"2026-02-13T01:23:50.314648+0000","last_became_peered":"2026-02-13T01:23:50.314648+0000","last_unstale":"2026-02-13T01:23:53.519536+0000","last_undegraded":"2026-02-13T01:23:53.519536+0000","last_fullsized":"2026-02-13T01:23:53.519536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:07:25.610347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958069+0000","last_change":"2026-02-13T01:23:51.078869+0000","last_active":"2026-02-13T01:23:52.958069+0000","last_peered":"2026-02-13T01:23:52.958069+0000","last_clean":"2026-02-13T01:23:52.958069+0000","last_became_active":"2026-02-13T01:23:51.078734+0000","last_became_peered":"2026-02-13T01:23:51.078734+0000","last_unstale":"2026-02-13T01:23:52.958069+0000","last_undegraded":"2026-02-13T01:23:52.958069+0000","last_fullsized":"2026-02-13T01:23:52.958069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:14:50.870485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104919+0000","last_change":"2026-02-13T01:23:50.316821+0000","last_active":"2026-02-13T01:23:56.104919+0000","last_peered":"2026-02-13T01:23:56.104919+0000","last_clean":"2026-02-13T01:23:56.104919+0000","last_became_active":"2026-02-13T01:23:50.316669+0000","last_became_peered":"2026-02-13T01:23:50.316669+0000","last_unstale":"2026-02-13T01:23:56.104919+0000","last_undegraded":"2026-02-13T01:23:56.104919+0000","last_fullsized":"2026-02-13T01:23:56.104919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:52:17.159425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958080+0000","last_change":"2026-02-13T01:23:51.076521+0000","last_active":"2026-02-13T01:23:52.958080+0000","last_peered":"2026-02-13T01:23:52.958080+0000","last_clean":"2026-02-13T01:23:52.958080+0000","last_became_active":"2026-02-13T01:23:51.076219+0000","last_became_peered":"2026-02-13T01:23:51.076219+0000","last_unstale":"2026-02-13T01:23:52.958080+0000","last_undegraded":"2026-02-13T01:23:52.958080+0000","last_fullsized":"2026-02-13T01:23:52.958080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:10:05.735481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":345,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957697+0000","last_change":"2026-02-13T01:23:25.213241+0000","last_active":"2026-02-13T01:23:52.957697+0000","last_peered":"2026-02-13T01:23:52.957697+0000","last_clean":"2026-02-13T01:23:52.957697+0000","last_became_active":"2026-02-13T01:23:25.213096+0000","last_became_peered":"2026-02-13T01:23:25.213096+0000","last_unstale":"2026-02-13T01:23:52.957697+0000","last_undegraded":"2026-02-13T01:23:52.957697+0000","last_fullsized":"2026-02-13T01:23:52.957697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:22:12.252296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:22:12.252296+0000","last_clean_scrub_stamp":"2026-02-13T01:22:12.252296+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:12:54.951823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.108146+0000","last_change":"2026-02-13T01:23:50.318186+0000","last_active":"2026-02-13T01:23:57.108146+0000","last_peered":"2026-02-13T01:23:57.108146+0000","last_clean":"2026-02-13T01:23:57.108146+0000","last_became_active":"2026-02-13T01:23:50.318061+0000","last_became_peered":"2026-02-13T01:23:50.318061+0000","last_unstale":"2026-02-13T01:23:57.108146+0000","last_undegraded":"2026-02-13T01:23:57.108146+0000","last_fullsized":"2026-02-13T01:23:57.108146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:10:10.620620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082418+0000","last_change":"2026-02-13T01:23:51.085525+0000","last_active":"2026-02-13T01:23:52.082418+0000","last_peered":"2026-02-13T01:23:52.082418+0000","last_clean":"2026-02-13T01:23:52.082418+0000","last_became_active":"2026-02-13T01:23:51.084975+0000","last_became_peered":"2026-02-13T01:23:51.084975+0000","last_unstale":"2026-02-13T01:23:52.082418+0000","last_undegraded":"2026-02-13T01:23:52.082418+0000","last_fullsized":"2026-02-13T01:23:52.082418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:01:08.986008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103570+0000","last_change":"2026-02-13T01:23:50.313460+0000","last_active":"2026-02-13T01:23:56.103570+0000","last_peered":"2026-02-13T01:23:56.103570+0000","last_clean":"2026-02-13T01:23:56.103570+0000","last_became_active":"2026-02-13T01:23:50.313104+0000","last_became_peered":"2026-02-13T01:23:50.313104+0000","last_unstale":"2026-02-13T01:23:56.103570+0000","last_undegraded":"2026-02-13T01:23:56.103570+0000","last_fullsized":"2026-02-13T01:23:56.103570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:52:48.495789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082426+0000","last_change":"2026-02-13T01:23:51.078650+0000","last_active":"2026-02-13T01:23:52.082426+0000","last_peered":"2026-02-13T01:23:52.082426+0000","last_clean":"2026-02-13T01:23:52.082426+0000","last_became_active":"2026-02-13T01:23:51.078574+0000","last_became_peered":"2026-02-13T01:23:51.078574+0000","last_unstale":"2026-02-13T01:23:52.082426+0000","last_undegraded":"2026-02-13T01:23:52.082426+0000","last_fullsized":"2026-02-13T01:23:52.082426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:06.316722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:07.123202+0000","last_change":"2026-02-13T01:23:50.319269+0000","last_active":"2026-02-13T01:24:07.123202+0000","last_peered":"2026-02-13T01:24:07.123202+0000","last_clean":"2026-02-13T01:24:07.123202+0000","last_became_active":"2026-02-13T01:23:50.319131+0000","last_became_peered":"2026-02-13T01:23:50.319131+0000","last_unstale":"2026-02-13T01:24:07.123202+0000","last_undegraded":"2026-02-13T01:24:07.123202+0000","last_fullsized":"2026-02-13T01:24:07.123202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:44:36.267282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081966+0000","last_change":"2026-02-13T01:23:51.079014+0000","last_active":"2026-02-13T01:23:52.081966+0000","last_peered":"2026-02-13T01:23:52.081966+0000","last_clean":"2026-02-13T01:23:52.081966+0000","last_became_active":"2026-02-13T01:23:51.078573+0000","last_became_peered":"2026-02-13T01:23:51.078573+0000","last_unstale":"2026-02-13T01:23:52.081966+0000","last_undegraded":"2026-02-13T01:23:52.081966+0000","last_fullsized":"2026-02-13T01:23:52.081966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:32:44.455948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957935+0000","last_change":"2026-02-13T01:23:50.317728+0000","last_active":"2026-02-13T01:23:52.957935+0000","last_peered":"2026-02-13T01:23:52.957935+0000","last_clean":"2026-02-13T01:23:52.957935+0000","last_became_active":"2026-02-13T01:23:50.317565+0000","last_became_peered":"2026-02-13T01:23:50.317565+0000","last_unstale":"2026-02-13T01:23:52.957935+0000","last_undegraded":"2026-02-13T01:23:52.957935+0000","last_fullsized":"2026-02-13T01:23:52.957935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:12:48.426265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081343+0000","last_change":"2026-02-13T01:23:51.085691+0000","last_active":"2026-02-13T01:23:52.081343+0000","last_peered":"2026-02-13T01:23:52.081343+0000","last_clean":"2026-02-13T01:23:52.081343+0000","last_became_active":"2026-02-13T01:23:51.085545+0000","last_became_peered":"2026-02-13T01:23:51.085545+0000","last_unstale":"2026-02-13T01:23:52.081343+0000","last_undegraded":"2026-02-13T01:23:52.081343+0000","last_fullsized":"2026-02-13T01:23:52.081343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:23.233907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084229+0000","last_change":"2026-02-13T01:23:50.320080+0000","last_active":"2026-02-13T01:23:52.084229+0000","last_peered":"2026-02-13T01:23:52.084229+0000","last_clean":"2026-02-13T01:23:52.084229+0000","last_became_active":"2026-02-13T01:23:50.319075+0000","last_became_peered":"2026-02-13T01:23:50.319075+0000","last_unstale":"2026-02-13T01:23:52.084229+0000","last_undegraded":"2026-02-13T01:23:52.084229+0000","last_fullsized":"2026-02-13T01:23:52.084229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:58:22.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.822589+0000","last_change":"2026-02-13T01:23:51.082738+0000","last_active":"2026-02-13T01:23:52.822589+0000","last_peered":"2026-02-13T01:23:52.822589+0000","last_clean":"2026-02-13T01:23:52.822589+0000","last_became_active":"2026-02-13T01:23:51.082642+0000","last_became_peered":"2026-02-13T01:23:51.082642+0000","last_unstale":"2026-02-13T01:23:52.822589+0000","last_undegraded":"2026-02-13T01:23:52.822589+0000","last_fullsized":"2026-02-13T01:23:52.822589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:21.938336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.101867+0000","last_change":"2026-02-13T01:23:50.319590+0000","last_active":"2026-02-13T01:23:55.101867+0000","last_peered":"2026-02-13T01:23:55.101867+0000","last_clean":"2026-02-13T01:23:55.101867+0000","last_became_active":"2026-02-13T01:23:50.319400+0000","last_became_peered":"2026-02-13T01:23:50.319400+0000","last_unstale":"2026-02-13T01:23:55.101867+0000","last_undegraded":"2026-02-13T01:23:55.101867+0000","last_fullsized":"2026-02-13T01:23:55.101867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:09:14.320587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084625+0000","last_change":"2026-02-13T01:23:51.086949+0000","last_active":"2026-02-13T01:23:52.084625+0000","last_peered":"2026-02-13T01:23:52.084625+0000","last_clean":"2026-02-13T01:23:52.084625+0000","last_became_active":"2026-02-13T01:23:51.083288+0000","last_became_peered":"2026-02-13T01:23:51.083288+0000","last_unstale":"2026-02-13T01:23:52.084625+0000","last_undegraded":"2026-02-13T01:23:52.084625+0000","last_fullsized":"2026-02-13T01:23:52.084625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:49:21.017914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:05.313106+0000","last_change":"2026-02-13T01:23:50.321788+0000","last_active":"2026-02-13T01:24:05.313106+0000","last_peered":"2026-02-13T01:24:05.313106+0000","last_clean":"2026-02-13T01:24:05.313106+0000","last_became_active":"2026-02-13T01:23:50.321507+0000","last_became_peered":"2026-02-13T01:23:50.321507+0000","last_unstale":"2026-02-13T01:24:05.313106+0000","last_undegraded":"2026-02-13T01:24:05.313106+0000","last_fullsized":"2026-02-13T01:24:05.313106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:05:53.096866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082956+0000","last_change":"2026-02-13T01:23:51.080914+0000","last_active":"2026-02-13T01:23:52.082956+0000","last_peered":"2026-02-13T01:23:52.082956+0000","last_clean":"2026-02-13T01:23:52.082956+0000","last_became_active":"2026-02-13T01:23:51.080613+0000","last_became_peered":"2026-02-13T01:23:51.080613+0000","last_unstale":"2026-02-13T01:23:52.082956+0000","last_undegraded":"2026-02-13T01:23:52.082956+0000","last_fullsized":"2026-02-13T01:23:52.082956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:27:22.311625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.098873+0000","last_change":"2026-02-13T01:23:50.317704+0000","last_active":"2026-02-13T01:23:55.098873+0000","last_peered":"2026-02-13T01:23:55.098873+0000","last_clean":"2026-02-13T01:23:55.098873+0000","last_became_active":"2026-02-13T01:23:50.317518+0000","last_became_peered":"2026-02-13T01:23:50.317518+0000","last_unstale":"2026-02-13T01:23:55.098873+0000","last_undegraded":"2026-02-13T01:23:55.098873+0000","last_fullsized":"2026-02-13T01:23:55.098873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:32:42.982192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083552+0000","last_change":"2026-02-13T01:23:51.082748+0000","last_active":"2026-02-13T01:23:52.083552+0000","last_peered":"2026-02-13T01:23:52.083552+0000","last_clean":"2026-02-13T01:23:52.083552+0000","last_became_active":"2026-02-13T01:23:51.082558+0000","last_became_peered":"2026-02-13T01:23:51.082558+0000","last_unstale":"2026-02-13T01:23:52.083552+0000","last_undegraded":"2026-02-13T01:23:52.083552+0000","last_fullsized":"2026-02-13T01:23:52.083552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:59:02.330871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100274+0000","last_change":"2026-02-13T01:23:50.316483+0000","last_active":"2026-02-13T01:23:55.100274+0000","last_peered":"2026-02-13T01:23:55.100274+0000","last_clean":"2026-02-13T01:23:55.100274+0000","last_became_active":"2026-02-13T01:23:50.316364+0000","last_became_peered":"2026-02-13T01:23:50.316364+0000","last_unstale":"2026-02-13T01:23:55.100274+0000","last_undegraded":"2026-02-13T01:23:55.100274+0000","last_fullsized":"2026-02-13T01:23:55.100274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:59:40.790096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312297+0000","last_change":"2026-02-13T01:23:51.077851+0000","last_active":"2026-02-13T01:23:52.312297+0000","last_peered":"2026-02-13T01:23:52.312297+0000","last_clean":"2026-02-13T01:23:52.312297+0000","last_became_active":"2026-02-13T01:23:51.077601+0000","last_became_peered":"2026-02-13T01:23:51.077601+0000","last_unstale":"2026-02-13T01:23:52.312297+0000","last_undegraded":"2026-02-13T01:23:52.312297+0000","last_fullsized":"2026-02-13T01:23:52.312297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:12.303405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.102650+0000","last_change":"2026-02-13T01:23:50.320431+0000","last_active":"2026-02-13T01:23:55.102650+0000","last_peered":"2026-02-13T01:23:55.102650+0000","last_clean":"2026-02-13T01:23:55.102650+0000","last_became_active":"2026-02-13T01:23:50.320143+0000","last_became_peered":"2026-02-13T01:23:50.320143+0000","last_unstale":"2026-02-13T01:23:55.102650+0000","last_undegraded":"2026-02-13T01:23:55.102650+0000","last_fullsized":"2026-02-13T01:23:55.102650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:33:25.290532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082293+0000","last_change":"2026-02-13T01:23:51.084550+0000","last_active":"2026-02-13T01:23:52.082293+0000","last_peered":"2026-02-13T01:23:52.082293+0000","last_clean":"2026-02-13T01:23:52.082293+0000","last_became_active":"2026-02-13T01:23:51.084383+0000","last_became_peered":"2026-02-13T01:23:51.084383+0000","last_unstale":"2026-02-13T01:23:52.082293+0000","last_undegraded":"2026-02-13T01:23:52.082293+0000","last_fullsized":"2026-02-13T01:23:52.082293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:04:28.333381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.974521+0000","last_change":"2026-02-13T01:23:50.317598+0000","last_active":"2026-02-13T01:23:52.974521+0000","last_peered":"2026-02-13T01:23:52.974521+0000","last_clean":"2026-02-13T01:23:52.974521+0000","last_became_active":"2026-02-13T01:23:50.317423+0000","last_became_peered":"2026-02-13T01:23:50.317423+0000","last_unstale":"2026-02-13T01:23:52.974521+0000","last_undegraded":"2026-02-13T01:23:52.974521+0000","last_fullsized":"2026-02-13T01:23:52.974521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:59:04.861370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082998+0000","last_change":"2026-02-13T01:23:51.086322+0000","last_active":"2026-02-13T01:23:52.082998+0000","last_peered":"2026-02-13T01:23:52.082998+0000","last_clean":"2026-02-13T01:23:52.082998+0000","last_became_active":"2026-02-13T01:23:51.086198+0000","last_became_peered":"2026-02-13T01:23:51.086198+0000","last_unstale":"2026-02-13T01:23:52.082998+0000","last_undegraded":"2026-02-13T01:23:52.082998+0000","last_fullsized":"2026-02-13T01:23:52.082998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:59.547632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100675+0000","last_change":"2026-02-13T01:23:50.313658+0000","last_active":"2026-02-13T01:23:55.100675+0000","last_peered":"2026-02-13T01:23:55.100675+0000","last_clean":"2026-02-13T01:23:55.100675+0000","last_became_active":"2026-02-13T01:23:50.313515+0000","last_became_peered":"2026-02-13T01:23:50.313515+0000","last_unstale":"2026-02-13T01:23:55.100675+0000","last_undegraded":"2026-02-13T01:23:55.100675+0000","last_fullsized":"2026-02-13T01:23:55.100675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:17.507776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957957+0000","last_change":"2026-02-13T01:23:51.075832+0000","last_active":"2026-02-13T01:23:52.957957+0000","last_peered":"2026-02-13T01:23:52.957957+0000","last_clean":"2026-02-13T01:23:52.957957+0000","last_became_active":"2026-02-13T01:23:51.075617+0000","last_became_peered":"2026-02-13T01:23:51.075617+0000","last_unstale":"2026-02-13T01:23:52.957957+0000","last_undegraded":"2026-02-13T01:23:52.957957+0000","last_fullsized":"2026-02-13T01:23:52.957957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:49.567688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082616+0000","last_change":"2026-02-13T01:23:51.078417+0000","last_active":"2026-02-13T01:23:52.082616+0000","last_peered":"2026-02-13T01:23:52.082616+0000","last_clean":"2026-02-13T01:23:52.082616+0000","last_became_active":"2026-02-13T01:23:51.078110+0000","last_became_peered":"2026-02-13T01:23:51.078110+0000","last_unstale":"2026-02-13T01:23:52.082616+0000","last_undegraded":"2026-02-13T01:23:52.082616+0000","last_fullsized":"2026-02-13T01:23:52.082616+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:40:32.031019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312559+0000","last_change":"2026-02-13T01:23:50.313168+0000","last_active":"2026-02-13T01:23:52.312559+0000","last_peered":"2026-02-13T01:23:52.312559+0000","last_clean":"2026-02-13T01:23:52.312559+0000","last_became_active":"2026-02-13T01:23:50.312966+0000","last_became_peered":"2026-02-13T01:23:50.312966+0000","last_unstale":"2026-02-13T01:23:52.312559+0000","last_undegraded":"2026-02-13T01:23:52.312559+0000","last_fullsized":"2026-02-13T01:23:52.312559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:32.590208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311295+0000","last_change":"2026-02-13T01:23:51.076660+0000","last_active":"2026-02-13T01:23:52.311295+0000","last_peered":"2026-02-13T01:23:52.311295+0000","last_clean":"2026-02-13T01:23:52.311295+0000","last_became_active":"2026-02-13T01:23:51.076469+0000","last_became_peered":"2026-02-13T01:23:51.076469+0000","last_unstale":"2026-02-13T01:23:52.311295+0000","last_undegraded":"2026-02-13T01:23:52.311295+0000","last_fullsized":"2026-02-13T01:23:52.311295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:36:41.529123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103548+0000","last_change":"2026-02-13T01:23:50.314141+0000","last_active":"2026-02-13T01:23:56.103548+0000","last_peered":"2026-02-13T01:23:56.103548+0000","last_clean":"2026-02-13T01:23:56.103548+0000","last_became_active":"2026-02-13T01:23:50.313895+0000","last_became_peered":"2026-02-13T01:23:50.313895+0000","last_unstale":"2026-02-13T01:23:56.103548+0000","last_undegraded":"2026-02-13T01:23:56.103548+0000","last_fullsized":"2026-02-13T01:23:56.103548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:56:45.835321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083174+0000","last_change":"2026-02-13T01:23:51.087445+0000","last_active":"2026-02-13T01:23:52.083174+0000","last_peered":"2026-02-13T01:23:52.083174+0000","last_clean":"2026-02-13T01:23:52.083174+0000","last_became_active":"2026-02-13T01:23:51.087127+0000","last_became_peered":"2026-02-13T01:23:51.087127+0000","last_unstale":"2026-02-13T01:23:52.083174+0000","last_undegraded":"2026-02-13T01:23:52.083174+0000","last_fullsized":"2026-02-13T01:23:52.083174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:26:20.819554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.289274+0000","last_change":"2026-02-13T01:23:50.317601+0000","last_active":"2026-02-13T01:23:52.289274+0000","last_peered":"2026-02-13T01:23:52.289274+0000","last_clean":"2026-02-13T01:23:52.289274+0000","last_became_active":"2026-02-13T01:23:50.316929+0000","last_became_peered":"2026-02-13T01:23:50.316929+0000","last_unstale":"2026-02-13T01:23:52.289274+0000","last_undegraded":"2026-02-13T01:23:52.289274+0000","last_fullsized":"2026-02-13T01:23:52.289274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:53:18.429548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083050+0000","last_change":"2026-02-13T01:23:51.080679+0000","last_active":"2026-02-13T01:23:52.083050+0000","last_peered":"2026-02-13T01:23:52.083050+0000","last_clean":"2026-02-13T01:23:52.083050+0000","last_became_active":"2026-02-13T01:23:51.080556+0000","last_became_peered":"2026-02-13T01:23:51.080556+0000","last_unstale":"2026-02-13T01:23:52.083050+0000","last_undegraded":"2026-02-13T01:23:52.083050+0000","last_fullsized":"2026-02-13T01:23:52.083050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:21.252518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.107473+0000","last_change":"2026-02-13T01:23:50.319592+0000","last_active":"2026-02-13T01:23:56.107473+0000","last_peered":"2026-02-13T01:23:56.107473+0000","last_clean":"2026-02-13T01:23:56.107473+0000","last_became_active":"2026-02-13T01:23:50.319512+0000","last_became_peered":"2026-02-13T01:23:50.319512+0000","last_unstale":"2026-02-13T01:23:56.107473+0000","last_undegraded":"2026-02-13T01:23:56.107473+0000","last_fullsized":"2026-02-13T01:23:56.107473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:49.061751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71077,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":97,"num_read_kb":120,"num_write":158,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":145866,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743433,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":390042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9130,"internal_metadata":27581526},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972363,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28440,"kb_used_data":1476,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733974760,"statfs":{"total":751619276800,"available":751590154240,"internally_reserved":0,"allocated":1511424,"data_stored":1048514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24624,"internal_metadata":27566032},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103181,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":390278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25192,"internal_metadata":27565464},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332111,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":390198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31974,"internal_metadata":27558682},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28348,"kb_used_data":1384,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733974852,"statfs":{"total":751619276800,"available":751590248448,"internally_reserved":0,"allocated":1417216,"data_stored":982147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27424,"internal_metadata":27563232},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":389645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134,"internal_metadata":27565522},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920789,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28360,"kb_used_data":1396,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733974840,"statfs":{"total":751619276800,"available":751590236160,"internally_reserved":0,"allocated":1429504,"data_stored":981831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31404,"internal_metadata":27559252},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051606,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":390082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37333,"internal_metadata":27553323},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280535,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":389956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46723,"internal_metadata":27543933},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476761,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":54,"kb_used_meta":26889,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":458211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55586,"internal_metadata":27535070},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607579,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":456429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":390960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47331,"internal_metadata":27543325},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7583,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29616,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34244,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7908,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3458,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4500,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11384,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13152,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9840,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18036,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:24:11.401 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:24:11.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:11 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3692212676' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:24:11.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:11 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3123763107' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:24:11.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:11 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/49085133' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:24:11.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:11 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1305150433' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:24:11.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:11 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/250732736' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:24:11.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:11 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4076308284' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:24:11.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:11 trial055 ceph-mon[27509]: pgmap v185: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 8.9 KiB/s rd, 7.1 KiB/s wr, 11 op/s 2026-02-13T01:24:11.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:11 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3692212676' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:24:11.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:11 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3123763107' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:24:11.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:11 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/49085133' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:24:11.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:11 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1305150433' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:24:11.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:11 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/250732736' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:24:11.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:11 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4076308284' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:24:11.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:11 trial118 ceph-mon[27812]: pgmap v185: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 8.9 KiB/s rd, 7.1 KiB/s wr, 11 op/s 2026-02-13T01:24:11.584 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:11.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.779+0000 7f74b774c6c0 1 -- 10.20.193.40:0/3417002769 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f74b010f200 msgr2=0x7f74b010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.779+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/3417002769 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f74b010f200 0x7f74b010f5d0 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=15255864238780897986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a00099a0 tx=0x7f74a002ed50 comp rx=0 tx=0).stop 2026-02-13T01:24:11.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.779+0000 7f74b774c6c0 1 -- 10.20.193.40:0/3417002769 shutdown_connections 2026-02-13T01:24:11.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.779+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/3417002769 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f74b0115410 0x7f74b0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.779+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/3417002769 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f74b010fbf0 0x7f74b0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.779+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/3417002769 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f74b010f200 0x7f74b010f5d0 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=15255864238780897986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.779+0000 7f74b774c6c0 1 -- 10.20.193.40:0/3417002769 >> 10.20.193.40:0/3417002769 conn(0x7f74b00ecb00 msgr2=0x7f74b010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:11.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.779+0000 7f74b774c6c0 1 -- 10.20.193.40:0/3417002769 shutdown_connections 2026-02-13T01:24:11.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.779+0000 7f74b774c6c0 1 -- 10.20.193.40:0/3417002769 wait complete. 2026-02-13T01:24:11.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.780+0000 7f74b774c6c0 1 Processor -- start 2026-02-13T01:24:11.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.780+0000 7f74b774c6c0 1 -- start start 2026-02-13T01:24:11.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.780+0000 7f74b774c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f74b010f200 0x7f74b011cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:11.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.780+0000 7f74b774c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f74b0115410 0x7f74b011d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:11.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.780+0000 7f74b774c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f74b01228b0 0x7f74b0122d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:11.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.780+0000 7f74b774c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f74b01232c0 con 0x7f74b01228b0 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.780+0000 7f74b774c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f74b0123430 con 0x7f74b0115410 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.780+0000 7f74b774c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f74b01235f0 con 0x7f74b010f200 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b54c16c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f74b010f200 0x7f74b011cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b5cc26c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f74b01228b0 0x7f74b0122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b4cc06c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f74b0115410 0x7f74b011d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b54c16c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f74b010f200 0x7f74b011cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:39270/0 (socket says 10.20.193.40:39270) 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b54c16c0 1 -- 10.20.193.40:0/1980685245 learned_addr learned my addr 10.20.193.40:0/1980685245 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b54c16c0 1 -- 10.20.193.40:0/1980685245 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f74b0115410 msgr2=0x7f74b011d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b54c16c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f74b0115410 0x7f74b011d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b54c16c0 1 -- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f74b01228b0 msgr2=0x7f74b0122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b54c16c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f74b01228b0 0x7f74b0122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b54c16c0 1 -- 10.20.193.40:0/1980685245 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a0009590 con 0x7f74b010f200 2026-02-13T01:24:11.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b5cc26c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f74b01228b0 0x7f74b0122d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:24:11.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f74b54c16c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f74b010f200 0x7f74b011cfb0 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a00098c0 tx=0x7f74a002f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:11.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.781+0000 7f749e7fc6c0 1 -- 10.20.193.40:0/1980685245 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74a00046b0 con 0x7f74b010f200 2026-02-13T01:24:11.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.782+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b0163a40 con 0x7f74b010f200 2026-02-13T01:24:11.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.782+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b0163ec0 con 0x7f74b010f200 2026-02-13T01:24:11.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.782+0000 7f749e7fc6c0 1 -- 10.20.193.40:0/1980685245 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f74a0002be0 con 0x7f74b010f200 2026-02-13T01:24:11.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.782+0000 7f749e7fc6c0 1 -- 10.20.193.40:0/1980685245 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74a00073f0 con 0x7f74b010f200 2026-02-13T01:24:11.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.782+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b01104d0 con 0x7f74b010f200 2026-02-13T01:24:11.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.784+0000 7f749e7fc6c0 1 -- 10.20.193.40:0/1980685245 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f74a00310c0 con 0x7f74b010f200 2026-02-13T01:24:11.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.786+0000 7f749e7fc6c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f748c0b5760 0x7f748c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:11.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.786+0000 7f749e7fc6c0 1 -- 10.20.193.40:0/1980685245 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f74a0107d30 con 0x7f74b010f200 2026-02-13T01:24:11.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.786+0000 7f74b4cc06c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f748c0b5760 0x7f748c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:11.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.786+0000 7f749e7fc6c0 1 -- 10.20.193.40:0/1980685245 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f74a01081b0 con 0x7f74b010f200 2026-02-13T01:24:11.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.786+0000 7f74b4cc06c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f748c0b5760 0x7f748c0d5c10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74b0123940 tx=0x7f74a40093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:11.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.885+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 --> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74b011e100 con 0x7f748c0b5760 2026-02-13T01:24:11.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.888+0000 7f749e7fc6c0 1 -- 10.20.193.40:0/1980685245 <== mgr.14190 v2:10.20.193.40:6800/1598245266 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258823 (secure 0 0 0) 0x7f74b011e100 con 0x7f748c0b5760 2026-02-13T01:24:11.892 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:11.894 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-13T01:24:11.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f748c0b5760 msgr2=0x7f748c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f748c0b5760 0x7f748c0d5c10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74b0123940 tx=0x7f74a40093f0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f74b010f200 msgr2=0x7f74b011cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:11.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f74b010f200 0x7f74b011cfb0 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a00098c0 tx=0x7f74a002f820 comp rx=0 tx=0).stop 2026-02-13T01:24:11.895 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 shutdown_connections 2026-02-13T01:24:11.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f748c0b5760 0x7f748c0d5c10 unknown :-1 s=CLOSED pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f74b01228b0 0x7f74b0122d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f74b0115410 0x7f74b011d4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 --2- 10.20.193.40:0/1980685245 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f74b010f200 0x7f74b011cfb0 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:11.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 >> 10.20.193.40:0/1980685245 conn(0x7f74b00ecb00 msgr2=0x7f74b010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:11.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 shutdown_connections 2026-02-13T01:24:11.896 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:11.890+0000 7f74b774c6c0 1 -- 10.20.193.40:0/1980685245 wait complete. 2026-02-13T01:24:11.994 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2026-02-13T01:24:10.691915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661679,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":211,"num_read_kb":219,"num_write":349,"num_write_kb":3838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":289,"ondisk_log_size":289,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335172,"kb_used_data":11604,"kb_used_omap":396,"kb_used_meta":322931,"kb_avail":8807703228,"statfs":{"total":9019431321600,"available":9019088105472,"internally_reserved":0,"allocated":11882496,"data_stored":6658293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":406175,"internal_metadata":330681697},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":59596,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":81,"num_read_kb":107,"num_write":61,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002342"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082432+0000","last_change":"2026-02-13T01:23:51.087785+0000","last_active":"2026-02-13T01:23:52.082432+0000","last_peered":"2026-02-13T01:23:52.082432+0000","last_clean":"2026-02-13T01:23:52.082432+0000","last_became_active":"2026-02-13T01:23:51.087666+0000","last_became_peered":"2026-02-13T01:23:51.087666+0000","last_unstale":"2026-02-13T01:23:52.082432+0000","last_undegraded":"2026-02-13T01:23:52.082432+0000","last_fullsized":"2026-02-13T01:23:52.082432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:35.585128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083500+0000","last_change":"2026-02-13T01:23:51.085295+0000","last_active":"2026-02-13T01:23:52.083500+0000","last_peered":"2026-02-13T01:23:52.083500+0000","last_clean":"2026-02-13T01:23:52.083500+0000","last_became_active":"2026-02-13T01:23:51.085131+0000","last_became_peered":"2026-02-13T01:23:51.085131+0000","last_unstale":"2026-02-13T01:23:52.083500+0000","last_undegraded":"2026-02-13T01:23:52.083500+0000","last_fullsized":"2026-02-13T01:23:52.083500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:18.129399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083128+0000","last_change":"2026-02-13T01:23:51.085354+0000","last_active":"2026-02-13T01:23:52.083128+0000","last_peered":"2026-02-13T01:23:52.083128+0000","last_clean":"2026-02-13T01:23:52.083128+0000","last_became_active":"2026-02-13T01:23:51.084953+0000","last_became_peered":"2026-02-13T01:23:51.084953+0000","last_unstale":"2026-02-13T01:23:52.083128+0000","last_undegraded":"2026-02-13T01:23:52.083128+0000","last_fullsized":"2026-02-13T01:23:52.083128+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:32.298388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311720+0000","last_change":"2026-02-13T01:23:51.077255+0000","last_active":"2026-02-13T01:23:52.311720+0000","last_peered":"2026-02-13T01:23:52.311720+0000","last_clean":"2026-02-13T01:23:52.311720+0000","last_became_active":"2026-02-13T01:23:51.076786+0000","last_became_peered":"2026-02-13T01:23:51.076786+0000","last_unstale":"2026-02-13T01:23:52.311720+0000","last_undegraded":"2026-02-13T01:23:52.311720+0000","last_fullsized":"2026-02-13T01:23:52.311720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:25.514019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312471+0000","last_change":"2026-02-13T01:23:51.078791+0000","last_active":"2026-02-13T01:23:52.312471+0000","last_peered":"2026-02-13T01:23:52.312471+0000","last_clean":"2026-02-13T01:23:52.312471+0000","last_became_active":"2026-02-13T01:23:51.078655+0000","last_became_peered":"2026-02-13T01:23:51.078655+0000","last_unstale":"2026-02-13T01:23:52.312471+0000","last_undegraded":"2026-02-13T01:23:52.312471+0000","last_fullsized":"2026-02-13T01:23:52.312471+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:39:11.299004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081309+0000","last_change":"2026-02-13T01:23:51.078732+0000","last_active":"2026-02-13T01:23:52.081309+0000","last_peered":"2026-02-13T01:23:52.081309+0000","last_clean":"2026-02-13T01:23:52.081309+0000","last_became_active":"2026-02-13T01:23:51.078623+0000","last_became_peered":"2026-02-13T01:23:51.078623+0000","last_unstale":"2026-02-13T01:23:52.081309+0000","last_undegraded":"2026-02-13T01:23:52.081309+0000","last_fullsized":"2026-02-13T01:23:52.081309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:44.150512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957653+0000","last_change":"2026-02-13T01:23:51.079852+0000","last_active":"2026-02-13T01:23:52.957653+0000","last_peered":"2026-02-13T01:23:52.957653+0000","last_clean":"2026-02-13T01:23:52.957653+0000","last_became_active":"2026-02-13T01:23:51.079722+0000","last_became_peered":"2026-02-13T01:23:51.079722+0000","last_unstale":"2026-02-13T01:23:52.957653+0000","last_undegraded":"2026-02-13T01:23:52.957653+0000","last_fullsized":"2026-02-13T01:23:52.957653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:05:57.521391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082415+0000","last_change":"2026-02-13T01:23:51.080431+0000","last_active":"2026-02-13T01:23:52.082415+0000","last_peered":"2026-02-13T01:23:52.082415+0000","last_clean":"2026-02-13T01:23:52.082415+0000","last_became_active":"2026-02-13T01:23:51.080137+0000","last_became_peered":"2026-02-13T01:23:51.080137+0000","last_unstale":"2026-02-13T01:23:52.082415+0000","last_undegraded":"2026-02-13T01:23:52.082415+0000","last_fullsized":"2026-02-13T01:23:52.082415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:24.824142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311585+0000","last_change":"2026-02-13T01:23:51.076636+0000","last_active":"2026-02-13T01:23:52.311585+0000","last_peered":"2026-02-13T01:23:52.311585+0000","last_clean":"2026-02-13T01:23:52.311585+0000","last_became_active":"2026-02-13T01:23:51.076457+0000","last_became_peered":"2026-02-13T01:23:51.076457+0000","last_unstale":"2026-02-13T01:23:52.311585+0000","last_undegraded":"2026-02-13T01:23:52.311585+0000","last_fullsized":"2026-02-13T01:23:52.311585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:25:35.580381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081654+0000","last_change":"2026-02-13T01:23:51.077042+0000","last_active":"2026-02-13T01:23:52.081654+0000","last_peered":"2026-02-13T01:23:52.081654+0000","last_clean":"2026-02-13T01:23:52.081654+0000","last_became_active":"2026-02-13T01:23:51.076925+0000","last_became_peered":"2026-02-13T01:23:51.076925+0000","last_unstale":"2026-02-13T01:23:52.081654+0000","last_undegraded":"2026-02-13T01:23:52.081654+0000","last_fullsized":"2026-02-13T01:23:52.081654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:24:36.245078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958059+0000","last_change":"2026-02-13T01:23:51.076945+0000","last_active":"2026-02-13T01:23:52.958059+0000","last_peered":"2026-02-13T01:23:52.958059+0000","last_clean":"2026-02-13T01:23:52.958059+0000","last_became_active":"2026-02-13T01:23:51.076801+0000","last_became_peered":"2026-02-13T01:23:51.076801+0000","last_unstale":"2026-02-13T01:23:52.958059+0000","last_undegraded":"2026-02-13T01:23:52.958059+0000","last_fullsized":"2026-02-13T01:23:52.958059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:14:06.277449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311818+0000","last_change":"2026-02-13T01:23:51.077720+0000","last_active":"2026-02-13T01:23:52.311818+0000","last_peered":"2026-02-13T01:23:52.311818+0000","last_clean":"2026-02-13T01:23:52.311818+0000","last_became_active":"2026-02-13T01:23:51.077217+0000","last_became_peered":"2026-02-13T01:23:51.077217+0000","last_unstale":"2026-02-13T01:23:52.311818+0000","last_undegraded":"2026-02-13T01:23:52.311818+0000","last_fullsized":"2026-02-13T01:23:52.311818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:33.011072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084544+0000","last_change":"2026-02-13T01:23:51.078177+0000","last_active":"2026-02-13T01:23:52.084544+0000","last_peered":"2026-02-13T01:23:52.084544+0000","last_clean":"2026-02-13T01:23:52.084544+0000","last_became_active":"2026-02-13T01:23:51.078110+0000","last_became_peered":"2026-02-13T01:23:51.078110+0000","last_unstale":"2026-02-13T01:23:52.084544+0000","last_undegraded":"2026-02-13T01:23:52.084544+0000","last_fullsized":"2026-02-13T01:23:52.084544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:59.357633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082814+0000","last_change":"2026-02-13T01:23:51.086034+0000","last_active":"2026-02-13T01:23:52.082814+0000","last_peered":"2026-02-13T01:23:52.082814+0000","last_clean":"2026-02-13T01:23:52.082814+0000","last_became_active":"2026-02-13T01:23:51.085782+0000","last_became_peered":"2026-02-13T01:23:51.085782+0000","last_unstale":"2026-02-13T01:23:52.082814+0000","last_undegraded":"2026-02-13T01:23:52.082814+0000","last_fullsized":"2026-02-13T01:23:52.082814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:28:34.185905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082761+0000","last_change":"2026-02-13T01:23:51.082750+0000","last_active":"2026-02-13T01:23:52.082761+0000","last_peered":"2026-02-13T01:23:52.082761+0000","last_clean":"2026-02-13T01:23:52.082761+0000","last_became_active":"2026-02-13T01:23:51.082533+0000","last_became_peered":"2026-02-13T01:23:51.082533+0000","last_unstale":"2026-02-13T01:23:52.082761+0000","last_undegraded":"2026-02-13T01:23:52.082761+0000","last_fullsized":"2026-02-13T01:23:52.082761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:10:33.600010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.310928+0000","last_change":"2026-02-13T01:23:51.083431+0000","last_active":"2026-02-13T01:23:52.310928+0000","last_peered":"2026-02-13T01:23:52.310928+0000","last_clean":"2026-02-13T01:23:52.310928+0000","last_became_active":"2026-02-13T01:23:51.083297+0000","last_became_peered":"2026-02-13T01:23:51.083297+0000","last_unstale":"2026-02-13T01:23:52.310928+0000","last_undegraded":"2026-02-13T01:23:52.310928+0000","last_fullsized":"2026-02-13T01:23:52.310928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:45:36.970802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082486+0000","last_change":"2026-02-13T01:23:51.087754+0000","last_active":"2026-02-13T01:23:52.082486+0000","last_peered":"2026-02-13T01:23:52.082486+0000","last_clean":"2026-02-13T01:23:52.082486+0000","last_became_active":"2026-02-13T01:23:51.087606+0000","last_became_peered":"2026-02-13T01:23:51.087606+0000","last_unstale":"2026-02-13T01:23:52.082486+0000","last_undegraded":"2026-02-13T01:23:52.082486+0000","last_fullsized":"2026-02-13T01:23:52.082486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:15.160137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084350+0000","last_change":"2026-02-13T01:23:51.082589+0000","last_active":"2026-02-13T01:23:52.084350+0000","last_peered":"2026-02-13T01:23:52.084350+0000","last_clean":"2026-02-13T01:23:52.084350+0000","last_became_active":"2026-02-13T01:23:51.081937+0000","last_became_peered":"2026-02-13T01:23:51.081937+0000","last_unstale":"2026-02-13T01:23:52.084350+0000","last_undegraded":"2026-02-13T01:23:52.084350+0000","last_fullsized":"2026-02-13T01:23:52.084350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:23:55.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312722+0000","last_change":"2026-02-13T01:23:51.083199+0000","last_active":"2026-02-13T01:23:52.312722+0000","last_peered":"2026-02-13T01:23:52.312722+0000","last_clean":"2026-02-13T01:23:52.312722+0000","last_became_active":"2026-02-13T01:23:51.083082+0000","last_became_peered":"2026-02-13T01:23:51.083082+0000","last_unstale":"2026-02-13T01:23:52.312722+0000","last_undegraded":"2026-02-13T01:23:52.312722+0000","last_fullsized":"2026-02-13T01:23:52.312722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:40:27.940964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082074+0000","last_change":"2026-02-13T01:23:51.078089+0000","last_active":"2026-02-13T01:23:52.082074+0000","last_peered":"2026-02-13T01:23:52.082074+0000","last_clean":"2026-02-13T01:23:52.082074+0000","last_became_active":"2026-02-13T01:23:51.077949+0000","last_became_peered":"2026-02-13T01:23:51.077949+0000","last_unstale":"2026-02-13T01:23:52.082074+0000","last_undegraded":"2026-02-13T01:23:52.082074+0000","last_fullsized":"2026-02-13T01:23:52.082074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:49:31.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084637+0000","last_change":"2026-02-13T01:23:51.087902+0000","last_active":"2026-02-13T01:23:52.084637+0000","last_peered":"2026-02-13T01:23:52.084637+0000","last_clean":"2026-02-13T01:23:52.084637+0000","last_became_active":"2026-02-13T01:23:51.087588+0000","last_became_peered":"2026-02-13T01:23:51.087588+0000","last_unstale":"2026-02-13T01:23:52.084637+0000","last_undegraded":"2026-02-13T01:23:52.084637+0000","last_fullsized":"2026-02-13T01:23:52.084637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:59:18.831776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311145+0000","last_change":"2026-02-13T01:23:51.082383+0000","last_active":"2026-02-13T01:23:52.311145+0000","last_peered":"2026-02-13T01:23:52.311145+0000","last_clean":"2026-02-13T01:23:52.311145+0000","last_became_active":"2026-02-13T01:23:51.082213+0000","last_became_peered":"2026-02-13T01:23:51.082213+0000","last_unstale":"2026-02-13T01:23:52.311145+0000","last_undegraded":"2026-02-13T01:23:52.311145+0000","last_fullsized":"2026-02-13T01:23:52.311145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:31:53.038095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082509+0000","last_change":"2026-02-13T01:23:51.084995+0000","last_active":"2026-02-13T01:23:52.082509+0000","last_peered":"2026-02-13T01:23:52.082509+0000","last_clean":"2026-02-13T01:23:52.082509+0000","last_became_active":"2026-02-13T01:23:51.084099+0000","last_became_peered":"2026-02-13T01:23:51.084099+0000","last_unstale":"2026-02-13T01:23:52.082509+0000","last_undegraded":"2026-02-13T01:23:52.082509+0000","last_fullsized":"2026-02-13T01:23:52.082509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:28:13.169004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081986+0000","last_change":"2026-02-13T01:23:51.079945+0000","last_active":"2026-02-13T01:23:52.081986+0000","last_peered":"2026-02-13T01:23:52.081986+0000","last_clean":"2026-02-13T01:23:52.081986+0000","last_became_active":"2026-02-13T01:23:51.079769+0000","last_became_peered":"2026-02-13T01:23:51.079769+0000","last_unstale":"2026-02-13T01:23:52.081986+0000","last_undegraded":"2026-02-13T01:23:52.081986+0000","last_fullsized":"2026-02-13T01:23:52.081986+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:35:23.092307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082900+0000","last_change":"2026-02-13T01:23:51.083623+0000","last_active":"2026-02-13T01:23:52.082900+0000","last_peered":"2026-02-13T01:23:52.082900+0000","last_clean":"2026-02-13T01:23:52.082900+0000","last_became_active":"2026-02-13T01:23:51.080812+0000","last_became_peered":"2026-02-13T01:23:51.080812+0000","last_unstale":"2026-02-13T01:23:52.082900+0000","last_undegraded":"2026-02-13T01:23:52.082900+0000","last_fullsized":"2026-02-13T01:23:52.082900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:11.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312793+0000","last_change":"2026-02-13T01:23:51.077158+0000","last_active":"2026-02-13T01:23:52.312793+0000","last_peered":"2026-02-13T01:23:52.312793+0000","last_clean":"2026-02-13T01:23:52.312793+0000","last_became_active":"2026-02-13T01:23:51.077028+0000","last_became_peered":"2026-02-13T01:23:51.077028+0000","last_unstale":"2026-02-13T01:23:52.312793+0000","last_undegraded":"2026-02-13T01:23:52.312793+0000","last_fullsized":"2026-02-13T01:23:52.312793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:58:04.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082315+0000","last_change":"2026-02-13T01:23:51.077585+0000","last_active":"2026-02-13T01:23:52.082315+0000","last_peered":"2026-02-13T01:23:52.082315+0000","last_clean":"2026-02-13T01:23:52.082315+0000","last_became_active":"2026-02-13T01:23:51.077411+0000","last_became_peered":"2026-02-13T01:23:51.077411+0000","last_unstale":"2026-02-13T01:23:52.082315+0000","last_undegraded":"2026-02-13T01:23:52.082315+0000","last_fullsized":"2026-02-13T01:23:52.082315+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:08.469350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084548+0000","last_change":"2026-02-13T01:23:51.087500+0000","last_active":"2026-02-13T01:23:52.084548+0000","last_peered":"2026-02-13T01:23:52.084548+0000","last_clean":"2026-02-13T01:23:52.084548+0000","last_became_active":"2026-02-13T01:23:51.087400+0000","last_became_peered":"2026-02-13T01:23:51.087400+0000","last_unstale":"2026-02-13T01:23:52.084548+0000","last_undegraded":"2026-02-13T01:23:52.084548+0000","last_fullsized":"2026-02-13T01:23:52.084548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:39.858050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083032+0000","last_change":"2026-02-13T01:23:51.086351+0000","last_active":"2026-02-13T01:23:52.083032+0000","last_peered":"2026-02-13T01:23:52.083032+0000","last_clean":"2026-02-13T01:23:52.083032+0000","last_became_active":"2026-02-13T01:23:51.086196+0000","last_became_peered":"2026-02-13T01:23:51.086196+0000","last_unstale":"2026-02-13T01:23:52.083032+0000","last_undegraded":"2026-02-13T01:23:52.083032+0000","last_fullsized":"2026-02-13T01:23:52.083032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:20:51.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312466+0000","last_change":"2026-02-13T01:23:51.086663+0000","last_active":"2026-02-13T01:23:52.312466+0000","last_peered":"2026-02-13T01:23:52.312466+0000","last_clean":"2026-02-13T01:23:52.312466+0000","last_became_active":"2026-02-13T01:23:51.086549+0000","last_became_peered":"2026-02-13T01:23:51.086549+0000","last_unstale":"2026-02-13T01:23:52.312466+0000","last_undegraded":"2026-02-13T01:23:52.312466+0000","last_fullsized":"2026-02-13T01:23:52.312466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:08.297213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312479+0000","last_change":"2026-02-13T01:23:51.079493+0000","last_active":"2026-02-13T01:23:52.312479+0000","last_peered":"2026-02-13T01:23:52.312479+0000","last_clean":"2026-02-13T01:23:52.312479+0000","last_became_active":"2026-02-13T01:23:51.079217+0000","last_became_peered":"2026-02-13T01:23:51.079217+0000","last_unstale":"2026-02-13T01:23:52.312479+0000","last_undegraded":"2026-02-13T01:23:52.312479+0000","last_fullsized":"2026-02-13T01:23:52.312479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:30:24.298223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081960+0000","last_change":"2026-02-13T01:23:51.079378+0000","last_active":"2026-02-13T01:23:52.081960+0000","last_peered":"2026-02-13T01:23:52.081960+0000","last_clean":"2026-02-13T01:23:52.081960+0000","last_became_active":"2026-02-13T01:23:51.079184+0000","last_became_peered":"2026-02-13T01:23:51.079184+0000","last_unstale":"2026-02-13T01:23:52.081960+0000","last_undegraded":"2026-02-13T01:23:52.081960+0000","last_fullsized":"2026-02-13T01:23:52.081960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:28:10.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312491+0000","last_change":"2026-02-13T01:23:51.079975+0000","last_active":"2026-02-13T01:23:52.312491+0000","last_peered":"2026-02-13T01:23:52.312491+0000","last_clean":"2026-02-13T01:23:52.312491+0000","last_became_active":"2026-02-13T01:23:51.079841+0000","last_became_peered":"2026-02-13T01:23:51.079841+0000","last_unstale":"2026-02-13T01:23:52.312491+0000","last_undegraded":"2026-02-13T01:23:52.312491+0000","last_fullsized":"2026-02-13T01:23:52.312491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:28.275600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:07.117291+0000","last_change":"2026-02-13T01:23:50.314202+0000","last_active":"2026-02-13T01:24:07.117291+0000","last_peered":"2026-02-13T01:24:07.117291+0000","last_clean":"2026-02-13T01:24:07.117291+0000","last_became_active":"2026-02-13T01:23:50.313965+0000","last_became_peered":"2026-02-13T01:23:50.313965+0000","last_unstale":"2026-02-13T01:24:07.117291+0000","last_undegraded":"2026-02-13T01:24:07.117291+0000","last_fullsized":"2026-02-13T01:24:07.117291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:58:16.283974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082398+0000","last_change":"2026-02-13T01:23:51.083970+0000","last_active":"2026-02-13T01:23:52.082398+0000","last_peered":"2026-02-13T01:23:52.082398+0000","last_clean":"2026-02-13T01:23:52.082398+0000","last_became_active":"2026-02-13T01:23:51.083823+0000","last_became_peered":"2026-02-13T01:23:51.083823+0000","last_unstale":"2026-02-13T01:23:52.082398+0000","last_undegraded":"2026-02-13T01:23:52.082398+0000","last_fullsized":"2026-02-13T01:23:52.082398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:18:40.333939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103253+0000","last_change":"2026-02-13T01:23:50.315973+0000","last_active":"2026-02-13T01:23:56.103253+0000","last_peered":"2026-02-13T01:23:56.103253+0000","last_clean":"2026-02-13T01:23:56.103253+0000","last_became_active":"2026-02-13T01:23:50.315798+0000","last_became_peered":"2026-02-13T01:23:50.315798+0000","last_unstale":"2026-02-13T01:23:56.103253+0000","last_undegraded":"2026-02-13T01:23:56.103253+0000","last_fullsized":"2026-02-13T01:23:56.103253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:40.079951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.108656+0000","last_change":"2026-02-13T01:23:50.321711+0000","last_active":"2026-02-13T01:23:56.108656+0000","last_peered":"2026-02-13T01:23:56.108656+0000","last_clean":"2026-02-13T01:23:56.108656+0000","last_became_active":"2026-02-13T01:23:50.320547+0000","last_became_peered":"2026-02-13T01:23:50.320547+0000","last_unstale":"2026-02-13T01:23:56.108656+0000","last_undegraded":"2026-02-13T01:23:56.108656+0000","last_fullsized":"2026-02-13T01:23:56.108656+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:07.279129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084082+0000","last_change":"2026-02-13T01:23:51.079484+0000","last_active":"2026-02-13T01:23:52.084082+0000","last_peered":"2026-02-13T01:23:52.084082+0000","last_clean":"2026-02-13T01:23:52.084082+0000","last_became_active":"2026-02-13T01:23:51.079364+0000","last_became_peered":"2026-02-13T01:23:51.079364+0000","last_unstale":"2026-02-13T01:23:52.084082+0000","last_undegraded":"2026-02-13T01:23:52.084082+0000","last_fullsized":"2026-02-13T01:23:52.084082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:46:25.508752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:53.519478+0000","last_change":"2026-02-13T01:23:50.313889+0000","last_active":"2026-02-13T01:23:53.519478+0000","last_peered":"2026-02-13T01:23:53.519478+0000","last_clean":"2026-02-13T01:23:53.519478+0000","last_became_active":"2026-02-13T01:23:50.313686+0000","last_became_peered":"2026-02-13T01:23:50.313686+0000","last_unstale":"2026-02-13T01:23:53.519478+0000","last_undegraded":"2026-02-13T01:23:53.519478+0000","last_fullsized":"2026-02-13T01:23:53.519478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:06.306071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084282+0000","last_change":"2026-02-13T01:23:51.085261+0000","last_active":"2026-02-13T01:23:52.084282+0000","last_peered":"2026-02-13T01:23:52.084282+0000","last_clean":"2026-02-13T01:23:52.084282+0000","last_became_active":"2026-02-13T01:23:51.085174+0000","last_became_peered":"2026-02-13T01:23:51.085174+0000","last_unstale":"2026-02-13T01:23:52.084282+0000","last_undegraded":"2026-02-13T01:23:52.084282+0000","last_fullsized":"2026-02-13T01:23:52.084282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:22:06.653604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:06.115569+0000","last_change":"2026-02-13T01:23:50.319556+0000","last_active":"2026-02-13T01:24:06.115569+0000","last_peered":"2026-02-13T01:24:06.115569+0000","last_clean":"2026-02-13T01:24:06.115569+0000","last_became_active":"2026-02-13T01:23:50.319416+0000","last_became_peered":"2026-02-13T01:23:50.319416+0000","last_unstale":"2026-02-13T01:24:06.115569+0000","last_undegraded":"2026-02-13T01:24:06.115569+0000","last_fullsized":"2026-02-13T01:24:06.115569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:21:13.508452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311504+0000","last_change":"2026-02-13T01:23:51.080630+0000","last_active":"2026-02-13T01:23:52.311504+0000","last_peered":"2026-02-13T01:23:52.311504+0000","last_clean":"2026-02-13T01:23:52.311504+0000","last_became_active":"2026-02-13T01:23:51.080523+0000","last_became_peered":"2026-02-13T01:23:51.080523+0000","last_unstale":"2026-02-13T01:23:52.311504+0000","last_undegraded":"2026-02-13T01:23:52.311504+0000","last_fullsized":"2026-02-13T01:23:52.311504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:31:27.515871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.099151+0000","last_change":"2026-02-13T01:23:50.313353+0000","last_active":"2026-02-13T01:23:55.099151+0000","last_peered":"2026-02-13T01:23:55.099151+0000","last_clean":"2026-02-13T01:23:55.099151+0000","last_became_active":"2026-02-13T01:23:50.312960+0000","last_became_peered":"2026-02-13T01:23:50.312960+0000","last_unstale":"2026-02-13T01:23:55.099151+0000","last_undegraded":"2026-02-13T01:23:55.099151+0000","last_fullsized":"2026-02-13T01:23:55.099151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:17.457348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083218+0000","last_change":"2026-02-13T01:23:51.085556+0000","last_active":"2026-02-13T01:23:52.083218+0000","last_peered":"2026-02-13T01:23:52.083218+0000","last_clean":"2026-02-13T01:23:52.083218+0000","last_became_active":"2026-02-13T01:23:51.084737+0000","last_became_peered":"2026-02-13T01:23:51.084737+0000","last_unstale":"2026-02-13T01:23:52.083218+0000","last_undegraded":"2026-02-13T01:23:52.083218+0000","last_fullsized":"2026-02-13T01:23:52.083218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:34.732291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.102259+0000","last_change":"2026-02-13T01:23:50.314013+0000","last_active":"2026-02-13T01:23:55.102259+0000","last_peered":"2026-02-13T01:23:55.102259+0000","last_clean":"2026-02-13T01:23:55.102259+0000","last_became_active":"2026-02-13T01:23:50.313750+0000","last_became_peered":"2026-02-13T01:23:50.313750+0000","last_unstale":"2026-02-13T01:23:55.102259+0000","last_undegraded":"2026-02-13T01:23:55.102259+0000","last_fullsized":"2026-02-13T01:23:55.102259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:11.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311298+0000","last_change":"2026-02-13T01:23:51.078331+0000","last_active":"2026-02-13T01:23:52.311298+0000","last_peered":"2026-02-13T01:23:52.311298+0000","last_clean":"2026-02-13T01:23:52.311298+0000","last_became_active":"2026-02-13T01:23:51.078107+0000","last_became_peered":"2026-02-13T01:23:51.078107+0000","last_unstale":"2026-02-13T01:23:52.311298+0000","last_undegraded":"2026-02-13T01:23:52.311298+0000","last_fullsized":"2026-02-13T01:23:52.311298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:01.797388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'26","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:07.117333+0000","last_change":"2026-02-13T01:23:50.312858+0000","last_active":"2026-02-13T01:24:07.117333+0000","last_peered":"2026-02-13T01:24:07.117333+0000","last_clean":"2026-02-13T01:24:07.117333+0000","last_became_active":"2026-02-13T01:23:50.312641+0000","last_became_peered":"2026-02-13T01:23:50.312641+0000","last_unstale":"2026-02-13T01:24:07.117333+0000","last_undegraded":"2026-02-13T01:24:07.117333+0000","last_fullsized":"2026-02-13T01:24:07.117333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:14.572231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66991,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":78,"num_write":27,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312665+0000","last_change":"2026-02-13T01:23:51.077407+0000","last_active":"2026-02-13T01:23:52.312665+0000","last_peered":"2026-02-13T01:23:52.312665+0000","last_clean":"2026-02-13T01:23:52.312665+0000","last_became_active":"2026-02-13T01:23:51.077180+0000","last_became_peered":"2026-02-13T01:23:51.077180+0000","last_unstale":"2026-02-13T01:23:52.312665+0000","last_undegraded":"2026-02-13T01:23:52.312665+0000","last_fullsized":"2026-02-13T01:23:52.312665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:40:00.558376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104764+0000","last_change":"2026-02-13T01:23:50.313114+0000","last_active":"2026-02-13T01:23:56.104764+0000","last_peered":"2026-02-13T01:23:56.104764+0000","last_clean":"2026-02-13T01:23:56.104764+0000","last_became_active":"2026-02-13T01:23:50.312955+0000","last_became_peered":"2026-02-13T01:23:50.312955+0000","last_unstale":"2026-02-13T01:23:56.104764+0000","last_undegraded":"2026-02-13T01:23:56.104764+0000","last_fullsized":"2026-02-13T01:23:56.104764+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:48:28.664538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084295+0000","last_change":"2026-02-13T01:23:51.087820+0000","last_active":"2026-02-13T01:23:52.084295+0000","last_peered":"2026-02-13T01:23:52.084295+0000","last_clean":"2026-02-13T01:23:52.084295+0000","last_became_active":"2026-02-13T01:23:51.087642+0000","last_became_peered":"2026-02-13T01:23:51.087642+0000","last_unstale":"2026-02-13T01:23:52.084295+0000","last_undegraded":"2026-02-13T01:23:52.084295+0000","last_fullsized":"2026-02-13T01:23:52.084295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:53:35.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.101071+0000","last_change":"2026-02-13T01:23:50.317064+0000","last_active":"2026-02-13T01:23:55.101071+0000","last_peered":"2026-02-13T01:23:55.101071+0000","last_clean":"2026-02-13T01:23:55.101071+0000","last_became_active":"2026-02-13T01:23:50.316871+0000","last_became_peered":"2026-02-13T01:23:50.316871+0000","last_unstale":"2026-02-13T01:23:55.101071+0000","last_undegraded":"2026-02-13T01:23:55.101071+0000","last_fullsized":"2026-02-13T01:23:55.101071+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:16.140406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957948+0000","last_change":"2026-02-13T01:23:51.076041+0000","last_active":"2026-02-13T01:23:52.957948+0000","last_peered":"2026-02-13T01:23:52.957948+0000","last_clean":"2026-02-13T01:23:52.957948+0000","last_became_active":"2026-02-13T01:23:51.075750+0000","last_became_peered":"2026-02-13T01:23:51.075750+0000","last_unstale":"2026-02-13T01:23:52.957948+0000","last_undegraded":"2026-02-13T01:23:52.957948+0000","last_fullsized":"2026-02-13T01:23:52.957948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:37:15.723754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:09.124761+0000","last_change":"2026-02-13T01:23:50.312631+0000","last_active":"2026-02-13T01:24:09.124761+0000","last_peered":"2026-02-13T01:24:09.124761+0000","last_clean":"2026-02-13T01:24:09.124761+0000","last_became_active":"2026-02-13T01:23:50.312445+0000","last_became_peered":"2026-02-13T01:23:50.312445+0000","last_unstale":"2026-02-13T01:24:09.124761+0000","last_undegraded":"2026-02-13T01:24:09.124761+0000","last_fullsized":"2026-02-13T01:24:09.124761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:40.527470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957625+0000","last_change":"2026-02-13T01:23:51.078230+0000","last_active":"2026-02-13T01:23:52.957625+0000","last_peered":"2026-02-13T01:23:52.957625+0000","last_clean":"2026-02-13T01:23:52.957625+0000","last_became_active":"2026-02-13T01:23:51.078113+0000","last_became_peered":"2026-02-13T01:23:51.078113+0000","last_unstale":"2026-02-13T01:23:52.957625+0000","last_undegraded":"2026-02-13T01:23:52.957625+0000","last_fullsized":"2026-02-13T01:23:52.957625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:09.649368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104938+0000","last_change":"2026-02-13T01:23:50.314144+0000","last_active":"2026-02-13T01:23:56.104938+0000","last_peered":"2026-02-13T01:23:56.104938+0000","last_clean":"2026-02-13T01:23:56.104938+0000","last_became_active":"2026-02-13T01:23:50.313897+0000","last_became_peered":"2026-02-13T01:23:50.313897+0000","last_unstale":"2026-02-13T01:23:56.104938+0000","last_undegraded":"2026-02-13T01:23:56.104938+0000","last_fullsized":"2026-02-13T01:23:56.104938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:36:50.923122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082071+0000","last_change":"2026-02-13T01:23:51.078401+0000","last_active":"2026-02-13T01:23:52.082071+0000","last_peered":"2026-02-13T01:23:52.082071+0000","last_clean":"2026-02-13T01:23:52.082071+0000","last_became_active":"2026-02-13T01:23:51.078113+0000","last_became_peered":"2026-02-13T01:23:51.078113+0000","last_unstale":"2026-02-13T01:23:52.082071+0000","last_undegraded":"2026-02-13T01:23:52.082071+0000","last_fullsized":"2026-02-13T01:23:52.082071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:38:58.059781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.108405+0000","last_change":"2026-02-13T01:23:50.311883+0000","last_active":"2026-02-13T01:23:57.108405+0000","last_peered":"2026-02-13T01:23:57.108405+0000","last_clean":"2026-02-13T01:23:57.108405+0000","last_became_active":"2026-02-13T01:23:50.311677+0000","last_became_peered":"2026-02-13T01:23:50.311677+0000","last_unstale":"2026-02-13T01:23:57.108405+0000","last_undegraded":"2026-02-13T01:23:57.108405+0000","last_fullsized":"2026-02-13T01:23:57.108405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:03:41.688088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082293+0000","last_change":"2026-02-13T01:23:51.077302+0000","last_active":"2026-02-13T01:23:52.082293+0000","last_peered":"2026-02-13T01:23:52.082293+0000","last_clean":"2026-02-13T01:23:52.082293+0000","last_became_active":"2026-02-13T01:23:51.077062+0000","last_became_peered":"2026-02-13T01:23:51.077062+0000","last_unstale":"2026-02-13T01:23:52.082293+0000","last_undegraded":"2026-02-13T01:23:52.082293+0000","last_fullsized":"2026-02-13T01:23:52.082293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:29:19.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084451+0000","last_change":"2026-02-13T01:23:50.318138+0000","last_active":"2026-02-13T01:23:52.084451+0000","last_peered":"2026-02-13T01:23:52.084451+0000","last_clean":"2026-02-13T01:23:52.084451+0000","last_became_active":"2026-02-13T01:23:50.318046+0000","last_became_peered":"2026-02-13T01:23:50.318046+0000","last_unstale":"2026-02-13T01:23:52.084451+0000","last_undegraded":"2026-02-13T01:23:52.084451+0000","last_fullsized":"2026-02-13T01:23:52.084451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:08:08.981534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958104+0000","last_change":"2026-02-13T01:23:51.076583+0000","last_active":"2026-02-13T01:23:52.958104+0000","last_peered":"2026-02-13T01:23:52.958104+0000","last_clean":"2026-02-13T01:23:52.958104+0000","last_became_active":"2026-02-13T01:23:51.076410+0000","last_became_peered":"2026-02-13T01:23:51.076410+0000","last_unstale":"2026-02-13T01:23:52.958104+0000","last_undegraded":"2026-02-13T01:23:52.958104+0000","last_fullsized":"2026-02-13T01:23:52.958104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:32.267216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:53.519536+0000","last_change":"2026-02-13T01:23:50.314790+0000","last_active":"2026-02-13T01:23:53.519536+0000","last_peered":"2026-02-13T01:23:53.519536+0000","last_clean":"2026-02-13T01:23:53.519536+0000","last_became_active":"2026-02-13T01:23:50.314648+0000","last_became_peered":"2026-02-13T01:23:50.314648+0000","last_unstale":"2026-02-13T01:23:53.519536+0000","last_undegraded":"2026-02-13T01:23:53.519536+0000","last_fullsized":"2026-02-13T01:23:53.519536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:07:25.610347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958069+0000","last_change":"2026-02-13T01:23:51.078869+0000","last_active":"2026-02-13T01:23:52.958069+0000","last_peered":"2026-02-13T01:23:52.958069+0000","last_clean":"2026-02-13T01:23:52.958069+0000","last_became_active":"2026-02-13T01:23:51.078734+0000","last_became_peered":"2026-02-13T01:23:51.078734+0000","last_unstale":"2026-02-13T01:23:52.958069+0000","last_undegraded":"2026-02-13T01:23:52.958069+0000","last_fullsized":"2026-02-13T01:23:52.958069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:14:50.870485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.104919+0000","last_change":"2026-02-13T01:23:50.316821+0000","last_active":"2026-02-13T01:23:56.104919+0000","last_peered":"2026-02-13T01:23:56.104919+0000","last_clean":"2026-02-13T01:23:56.104919+0000","last_became_active":"2026-02-13T01:23:50.316669+0000","last_became_peered":"2026-02-13T01:23:50.316669+0000","last_unstale":"2026-02-13T01:23:56.104919+0000","last_undegraded":"2026-02-13T01:23:56.104919+0000","last_fullsized":"2026-02-13T01:23:56.104919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:52:17.159425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.958080+0000","last_change":"2026-02-13T01:23:51.076521+0000","last_active":"2026-02-13T01:23:52.958080+0000","last_peered":"2026-02-13T01:23:52.958080+0000","last_clean":"2026-02-13T01:23:52.958080+0000","last_became_active":"2026-02-13T01:23:51.076219+0000","last_became_peered":"2026-02-13T01:23:51.076219+0000","last_unstale":"2026-02-13T01:23:52.958080+0000","last_undegraded":"2026-02-13T01:23:52.958080+0000","last_fullsized":"2026-02-13T01:23:52.958080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:10:05.735481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":345,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957697+0000","last_change":"2026-02-13T01:23:25.213241+0000","last_active":"2026-02-13T01:23:52.957697+0000","last_peered":"2026-02-13T01:23:52.957697+0000","last_clean":"2026-02-13T01:23:52.957697+0000","last_became_active":"2026-02-13T01:23:25.213096+0000","last_became_peered":"2026-02-13T01:23:25.213096+0000","last_unstale":"2026-02-13T01:23:52.957697+0000","last_undegraded":"2026-02-13T01:23:52.957697+0000","last_fullsized":"2026-02-13T01:23:52.957697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:22:12.252296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:22:12.252296+0000","last_clean_scrub_stamp":"2026-02-13T01:22:12.252296+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:12:54.951823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:57.108146+0000","last_change":"2026-02-13T01:23:50.318186+0000","last_active":"2026-02-13T01:23:57.108146+0000","last_peered":"2026-02-13T01:23:57.108146+0000","last_clean":"2026-02-13T01:23:57.108146+0000","last_became_active":"2026-02-13T01:23:50.318061+0000","last_became_peered":"2026-02-13T01:23:50.318061+0000","last_unstale":"2026-02-13T01:23:57.108146+0000","last_undegraded":"2026-02-13T01:23:57.108146+0000","last_fullsized":"2026-02-13T01:23:57.108146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:10:10.620620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082418+0000","last_change":"2026-02-13T01:23:51.085525+0000","last_active":"2026-02-13T01:23:52.082418+0000","last_peered":"2026-02-13T01:23:52.082418+0000","last_clean":"2026-02-13T01:23:52.082418+0000","last_became_active":"2026-02-13T01:23:51.084975+0000","last_became_peered":"2026-02-13T01:23:51.084975+0000","last_unstale":"2026-02-13T01:23:52.082418+0000","last_undegraded":"2026-02-13T01:23:52.082418+0000","last_fullsized":"2026-02-13T01:23:52.082418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:01:08.986008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103570+0000","last_change":"2026-02-13T01:23:50.313460+0000","last_active":"2026-02-13T01:23:56.103570+0000","last_peered":"2026-02-13T01:23:56.103570+0000","last_clean":"2026-02-13T01:23:56.103570+0000","last_became_active":"2026-02-13T01:23:50.313104+0000","last_became_peered":"2026-02-13T01:23:50.313104+0000","last_unstale":"2026-02-13T01:23:56.103570+0000","last_undegraded":"2026-02-13T01:23:56.103570+0000","last_fullsized":"2026-02-13T01:23:56.103570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:52:48.495789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082426+0000","last_change":"2026-02-13T01:23:51.078650+0000","last_active":"2026-02-13T01:23:52.082426+0000","last_peered":"2026-02-13T01:23:52.082426+0000","last_clean":"2026-02-13T01:23:52.082426+0000","last_became_active":"2026-02-13T01:23:51.078574+0000","last_became_peered":"2026-02-13T01:23:51.078574+0000","last_unstale":"2026-02-13T01:23:52.082426+0000","last_undegraded":"2026-02-13T01:23:52.082426+0000","last_fullsized":"2026-02-13T01:23:52.082426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:06.316722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:07.123202+0000","last_change":"2026-02-13T01:23:50.319269+0000","last_active":"2026-02-13T01:24:07.123202+0000","last_peered":"2026-02-13T01:24:07.123202+0000","last_clean":"2026-02-13T01:24:07.123202+0000","last_became_active":"2026-02-13T01:23:50.319131+0000","last_became_peered":"2026-02-13T01:23:50.319131+0000","last_unstale":"2026-02-13T01:24:07.123202+0000","last_undegraded":"2026-02-13T01:24:07.123202+0000","last_fullsized":"2026-02-13T01:24:07.123202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:44:36.267282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081966+0000","last_change":"2026-02-13T01:23:51.079014+0000","last_active":"2026-02-13T01:23:52.081966+0000","last_peered":"2026-02-13T01:23:52.081966+0000","last_clean":"2026-02-13T01:23:52.081966+0000","last_became_active":"2026-02-13T01:23:51.078573+0000","last_became_peered":"2026-02-13T01:23:51.078573+0000","last_unstale":"2026-02-13T01:23:52.081966+0000","last_undegraded":"2026-02-13T01:23:52.081966+0000","last_fullsized":"2026-02-13T01:23:52.081966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:32:44.455948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957935+0000","last_change":"2026-02-13T01:23:50.317728+0000","last_active":"2026-02-13T01:23:52.957935+0000","last_peered":"2026-02-13T01:23:52.957935+0000","last_clean":"2026-02-13T01:23:52.957935+0000","last_became_active":"2026-02-13T01:23:50.317565+0000","last_became_peered":"2026-02-13T01:23:50.317565+0000","last_unstale":"2026-02-13T01:23:52.957935+0000","last_undegraded":"2026-02-13T01:23:52.957935+0000","last_fullsized":"2026-02-13T01:23:52.957935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:12:48.426265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.081343+0000","last_change":"2026-02-13T01:23:51.085691+0000","last_active":"2026-02-13T01:23:52.081343+0000","last_peered":"2026-02-13T01:23:52.081343+0000","last_clean":"2026-02-13T01:23:52.081343+0000","last_became_active":"2026-02-13T01:23:51.085545+0000","last_became_peered":"2026-02-13T01:23:51.085545+0000","last_unstale":"2026-02-13T01:23:52.081343+0000","last_undegraded":"2026-02-13T01:23:52.081343+0000","last_fullsized":"2026-02-13T01:23:52.081343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:23.233907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084229+0000","last_change":"2026-02-13T01:23:50.320080+0000","last_active":"2026-02-13T01:23:52.084229+0000","last_peered":"2026-02-13T01:23:52.084229+0000","last_clean":"2026-02-13T01:23:52.084229+0000","last_became_active":"2026-02-13T01:23:50.319075+0000","last_became_peered":"2026-02-13T01:23:50.319075+0000","last_unstale":"2026-02-13T01:23:52.084229+0000","last_undegraded":"2026-02-13T01:23:52.084229+0000","last_fullsized":"2026-02-13T01:23:52.084229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:58:22.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.822589+0000","last_change":"2026-02-13T01:23:51.082738+0000","last_active":"2026-02-13T01:23:52.822589+0000","last_peered":"2026-02-13T01:23:52.822589+0000","last_clean":"2026-02-13T01:23:52.822589+0000","last_became_active":"2026-02-13T01:23:51.082642+0000","last_became_peered":"2026-02-13T01:23:51.082642+0000","last_unstale":"2026-02-13T01:23:52.822589+0000","last_undegraded":"2026-02-13T01:23:52.822589+0000","last_fullsized":"2026-02-13T01:23:52.822589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:21.938336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.101867+0000","last_change":"2026-02-13T01:23:50.319590+0000","last_active":"2026-02-13T01:23:55.101867+0000","last_peered":"2026-02-13T01:23:55.101867+0000","last_clean":"2026-02-13T01:23:55.101867+0000","last_became_active":"2026-02-13T01:23:50.319400+0000","last_became_peered":"2026-02-13T01:23:50.319400+0000","last_unstale":"2026-02-13T01:23:55.101867+0000","last_undegraded":"2026-02-13T01:23:55.101867+0000","last_fullsized":"2026-02-13T01:23:55.101867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:09:14.320587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.084625+0000","last_change":"2026-02-13T01:23:51.086949+0000","last_active":"2026-02-13T01:23:52.084625+0000","last_peered":"2026-02-13T01:23:52.084625+0000","last_clean":"2026-02-13T01:23:52.084625+0000","last_became_active":"2026-02-13T01:23:51.083288+0000","last_became_peered":"2026-02-13T01:23:51.083288+0000","last_unstale":"2026-02-13T01:23:52.084625+0000","last_undegraded":"2026-02-13T01:23:52.084625+0000","last_fullsized":"2026-02-13T01:23:52.084625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:49:21.017914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:24:05.313106+0000","last_change":"2026-02-13T01:23:50.321788+0000","last_active":"2026-02-13T01:24:05.313106+0000","last_peered":"2026-02-13T01:24:05.313106+0000","last_clean":"2026-02-13T01:24:05.313106+0000","last_became_active":"2026-02-13T01:23:50.321507+0000","last_became_peered":"2026-02-13T01:23:50.321507+0000","last_unstale":"2026-02-13T01:24:05.313106+0000","last_undegraded":"2026-02-13T01:24:05.313106+0000","last_fullsized":"2026-02-13T01:24:05.313106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:05:53.096866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082956+0000","last_change":"2026-02-13T01:23:51.080914+0000","last_active":"2026-02-13T01:23:52.082956+0000","last_peered":"2026-02-13T01:23:52.082956+0000","last_clean":"2026-02-13T01:23:52.082956+0000","last_became_active":"2026-02-13T01:23:51.080613+0000","last_became_peered":"2026-02-13T01:23:51.080613+0000","last_unstale":"2026-02-13T01:23:52.082956+0000","last_undegraded":"2026-02-13T01:23:52.082956+0000","last_fullsized":"2026-02-13T01:23:52.082956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:27:22.311625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.098873+0000","last_change":"2026-02-13T01:23:50.317704+0000","last_active":"2026-02-13T01:23:55.098873+0000","last_peered":"2026-02-13T01:23:55.098873+0000","last_clean":"2026-02-13T01:23:55.098873+0000","last_became_active":"2026-02-13T01:23:50.317518+0000","last_became_peered":"2026-02-13T01:23:50.317518+0000","last_unstale":"2026-02-13T01:23:55.098873+0000","last_undegraded":"2026-02-13T01:23:55.098873+0000","last_fullsized":"2026-02-13T01:23:55.098873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:32:42.982192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083552+0000","last_change":"2026-02-13T01:23:51.082748+0000","last_active":"2026-02-13T01:23:52.083552+0000","last_peered":"2026-02-13T01:23:52.083552+0000","last_clean":"2026-02-13T01:23:52.083552+0000","last_became_active":"2026-02-13T01:23:51.082558+0000","last_became_peered":"2026-02-13T01:23:51.082558+0000","last_unstale":"2026-02-13T01:23:52.083552+0000","last_undegraded":"2026-02-13T01:23:52.083552+0000","last_fullsized":"2026-02-13T01:23:52.083552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:59:02.330871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100274+0000","last_change":"2026-02-13T01:23:50.316483+0000","last_active":"2026-02-13T01:23:55.100274+0000","last_peered":"2026-02-13T01:23:55.100274+0000","last_clean":"2026-02-13T01:23:55.100274+0000","last_became_active":"2026-02-13T01:23:50.316364+0000","last_became_peered":"2026-02-13T01:23:50.316364+0000","last_unstale":"2026-02-13T01:23:55.100274+0000","last_undegraded":"2026-02-13T01:23:55.100274+0000","last_fullsized":"2026-02-13T01:23:55.100274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:59:40.790096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312297+0000","last_change":"2026-02-13T01:23:51.077851+0000","last_active":"2026-02-13T01:23:52.312297+0000","last_peered":"2026-02-13T01:23:52.312297+0000","last_clean":"2026-02-13T01:23:52.312297+0000","last_became_active":"2026-02-13T01:23:51.077601+0000","last_became_peered":"2026-02-13T01:23:51.077601+0000","last_unstale":"2026-02-13T01:23:52.312297+0000","last_undegraded":"2026-02-13T01:23:52.312297+0000","last_fullsized":"2026-02-13T01:23:52.312297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:12.303405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.102650+0000","last_change":"2026-02-13T01:23:50.320431+0000","last_active":"2026-02-13T01:23:55.102650+0000","last_peered":"2026-02-13T01:23:55.102650+0000","last_clean":"2026-02-13T01:23:55.102650+0000","last_became_active":"2026-02-13T01:23:50.320143+0000","last_became_peered":"2026-02-13T01:23:50.320143+0000","last_unstale":"2026-02-13T01:23:55.102650+0000","last_undegraded":"2026-02-13T01:23:55.102650+0000","last_fullsized":"2026-02-13T01:23:55.102650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:33:25.290532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082293+0000","last_change":"2026-02-13T01:23:51.084550+0000","last_active":"2026-02-13T01:23:52.082293+0000","last_peered":"2026-02-13T01:23:52.082293+0000","last_clean":"2026-02-13T01:23:52.082293+0000","last_became_active":"2026-02-13T01:23:51.084383+0000","last_became_peered":"2026-02-13T01:23:51.084383+0000","last_unstale":"2026-02-13T01:23:52.082293+0000","last_undegraded":"2026-02-13T01:23:52.082293+0000","last_fullsized":"2026-02-13T01:23:52.082293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:04:28.333381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.974521+0000","last_change":"2026-02-13T01:23:50.317598+0000","last_active":"2026-02-13T01:23:52.974521+0000","last_peered":"2026-02-13T01:23:52.974521+0000","last_clean":"2026-02-13T01:23:52.974521+0000","last_became_active":"2026-02-13T01:23:50.317423+0000","last_became_peered":"2026-02-13T01:23:50.317423+0000","last_unstale":"2026-02-13T01:23:52.974521+0000","last_undegraded":"2026-02-13T01:23:52.974521+0000","last_fullsized":"2026-02-13T01:23:52.974521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:59:04.861370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082998+0000","last_change":"2026-02-13T01:23:51.086322+0000","last_active":"2026-02-13T01:23:52.082998+0000","last_peered":"2026-02-13T01:23:52.082998+0000","last_clean":"2026-02-13T01:23:52.082998+0000","last_became_active":"2026-02-13T01:23:51.086198+0000","last_became_peered":"2026-02-13T01:23:51.086198+0000","last_unstale":"2026-02-13T01:23:52.082998+0000","last_undegraded":"2026-02-13T01:23:52.082998+0000","last_fullsized":"2026-02-13T01:23:52.082998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:59.547632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:55.100675+0000","last_change":"2026-02-13T01:23:50.313658+0000","last_active":"2026-02-13T01:23:55.100675+0000","last_peered":"2026-02-13T01:23:55.100675+0000","last_clean":"2026-02-13T01:23:55.100675+0000","last_became_active":"2026-02-13T01:23:50.313515+0000","last_became_peered":"2026-02-13T01:23:50.313515+0000","last_unstale":"2026-02-13T01:23:55.100675+0000","last_undegraded":"2026-02-13T01:23:55.100675+0000","last_fullsized":"2026-02-13T01:23:55.100675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:17.507776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.957957+0000","last_change":"2026-02-13T01:23:51.075832+0000","last_active":"2026-02-13T01:23:52.957957+0000","last_peered":"2026-02-13T01:23:52.957957+0000","last_clean":"2026-02-13T01:23:52.957957+0000","last_became_active":"2026-02-13T01:23:51.075617+0000","last_became_peered":"2026-02-13T01:23:51.075617+0000","last_unstale":"2026-02-13T01:23:52.957957+0000","last_undegraded":"2026-02-13T01:23:52.957957+0000","last_fullsized":"2026-02-13T01:23:52.957957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:49.567688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.082616+0000","last_change":"2026-02-13T01:23:51.078417+0000","last_active":"2026-02-13T01:23:52.082616+0000","last_peered":"2026-02-13T01:23:52.082616+0000","last_clean":"2026-02-13T01:23:52.082616+0000","last_became_active":"2026-02-13T01:23:51.078110+0000","last_became_peered":"2026-02-13T01:23:51.078110+0000","last_unstale":"2026-02-13T01:23:52.082616+0000","last_undegraded":"2026-02-13T01:23:52.082616+0000","last_fullsized":"2026-02-13T01:23:52.082616+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:40:32.031019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.312559+0000","last_change":"2026-02-13T01:23:50.313168+0000","last_active":"2026-02-13T01:23:52.312559+0000","last_peered":"2026-02-13T01:23:52.312559+0000","last_clean":"2026-02-13T01:23:52.312559+0000","last_became_active":"2026-02-13T01:23:50.312966+0000","last_became_peered":"2026-02-13T01:23:50.312966+0000","last_unstale":"2026-02-13T01:23:52.312559+0000","last_undegraded":"2026-02-13T01:23:52.312559+0000","last_fullsized":"2026-02-13T01:23:52.312559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:32.590208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.311295+0000","last_change":"2026-02-13T01:23:51.076660+0000","last_active":"2026-02-13T01:23:52.311295+0000","last_peered":"2026-02-13T01:23:52.311295+0000","last_clean":"2026-02-13T01:23:52.311295+0000","last_became_active":"2026-02-13T01:23:51.076469+0000","last_became_peered":"2026-02-13T01:23:51.076469+0000","last_unstale":"2026-02-13T01:23:52.311295+0000","last_undegraded":"2026-02-13T01:23:52.311295+0000","last_fullsized":"2026-02-13T01:23:52.311295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:36:41.529123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.103548+0000","last_change":"2026-02-13T01:23:50.314141+0000","last_active":"2026-02-13T01:23:56.103548+0000","last_peered":"2026-02-13T01:23:56.103548+0000","last_clean":"2026-02-13T01:23:56.103548+0000","last_became_active":"2026-02-13T01:23:50.313895+0000","last_became_peered":"2026-02-13T01:23:50.313895+0000","last_unstale":"2026-02-13T01:23:56.103548+0000","last_undegraded":"2026-02-13T01:23:56.103548+0000","last_fullsized":"2026-02-13T01:23:56.103548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:56:45.835321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083174+0000","last_change":"2026-02-13T01:23:51.087445+0000","last_active":"2026-02-13T01:23:52.083174+0000","last_peered":"2026-02-13T01:23:52.083174+0000","last_clean":"2026-02-13T01:23:52.083174+0000","last_became_active":"2026-02-13T01:23:51.087127+0000","last_became_peered":"2026-02-13T01:23:51.087127+0000","last_unstale":"2026-02-13T01:23:52.083174+0000","last_undegraded":"2026-02-13T01:23:52.083174+0000","last_fullsized":"2026-02-13T01:23:52.083174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:26:20.819554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.289274+0000","last_change":"2026-02-13T01:23:50.317601+0000","last_active":"2026-02-13T01:23:52.289274+0000","last_peered":"2026-02-13T01:23:52.289274+0000","last_clean":"2026-02-13T01:23:52.289274+0000","last_became_active":"2026-02-13T01:23:50.316929+0000","last_became_peered":"2026-02-13T01:23:50.316929+0000","last_unstale":"2026-02-13T01:23:52.289274+0000","last_undegraded":"2026-02-13T01:23:52.289274+0000","last_fullsized":"2026-02-13T01:23:52.289274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:53:18.429548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:52.083050+0000","last_change":"2026-02-13T01:23:51.080679+0000","last_active":"2026-02-13T01:23:52.083050+0000","last_peered":"2026-02-13T01:23:52.083050+0000","last_clean":"2026-02-13T01:23:52.083050+0000","last_became_active":"2026-02-13T01:23:51.080556+0000","last_became_peered":"2026-02-13T01:23:51.080556+0000","last_unstale":"2026-02-13T01:23:52.083050+0000","last_undegraded":"2026-02-13T01:23:52.083050+0000","last_fullsized":"2026-02-13T01:23:52.083050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:50.305467+0000","last_clean_scrub_stamp":"2026-02-13T01:23:50.305467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:21.252518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2026-02-13T01:23:56.107473+0000","last_change":"2026-02-13T01:23:50.319592+0000","last_active":"2026-02-13T01:23:56.107473+0000","last_peered":"2026-02-13T01:23:56.107473+0000","last_clean":"2026-02-13T01:23:56.107473+0000","last_became_active":"2026-02-13T01:23:50.319512+0000","last_became_peered":"2026-02-13T01:23:50.319512+0000","last_unstale":"2026-02-13T01:23:56.107473+0000","last_undegraded":"2026-02-13T01:23:56.107473+0000","last_fullsized":"2026-02-13T01:23:56.107473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:49.301542+0000","last_clean_scrub_stamp":"2026-02-13T01:23:49.301542+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:49.061751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71077,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":97,"num_read_kb":120,"num_write":158,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":145866,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743433,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":390042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9130,"internal_metadata":27581526},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972363,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28440,"kb_used_data":1476,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733974760,"statfs":{"total":751619276800,"available":751590154240,"internally_reserved":0,"allocated":1511424,"data_stored":1048514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24624,"internal_metadata":27566032},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103181,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":390278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25192,"internal_metadata":27565464},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332111,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":390198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31974,"internal_metadata":27558682},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28348,"kb_used_data":1384,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733974852,"statfs":{"total":751619276800,"available":751590248448,"internally_reserved":0,"allocated":1417216,"data_stored":982147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27424,"internal_metadata":27563232},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":389645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134,"internal_metadata":27565522},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920789,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28360,"kb_used_data":1396,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733974840,"statfs":{"total":751619276800,"available":751590236160,"internally_reserved":0,"allocated":1429504,"data_stored":981831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31404,"internal_metadata":27559252},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051606,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":390082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37333,"internal_metadata":27553323},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280535,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":389956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46723,"internal_metadata":27543933},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476761,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":54,"kb_used_meta":26889,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":458211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55586,"internal_metadata":27535070},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607579,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":456429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":390960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47331,"internal_metadata":27543325},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7583,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29616,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34244,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7908,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3458,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4500,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11384,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13152,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9840,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18036,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:24:12.001 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T01:24:12.001 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T01:24:12.001 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-13T01:24:12.001 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:12.161 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:12 trial040 ceph-mon[23046]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:12.187 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:12.379 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.378+0000 7f22f319b6c0 1 -- 10.20.193.40:0/4071780881 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec114190 msgr2=0x7f22ec115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:12.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.378+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/4071780881 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec114190 0x7f22ec115d40 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=15350571903594606700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22e00099a0 tx=0x7f22e002ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:12.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.378+0000 7f22f319b6c0 1 -- 10.20.193.40:0/4071780881 shutdown_connections 2026-02-13T01:24:12.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.378+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/4071780881 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f22ec116520 0x7f22ec17a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.378+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/4071780881 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec114190 0x7f22ec115d40 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=15350571903594606700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.378+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/4071780881 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f22ec1137a0 0x7f22ec113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.378+0000 7f22f319b6c0 1 -- 10.20.193.40:0/4071780881 >> 10.20.193.40:0/4071780881 conn(0x7f22ec061510 msgr2=0x7f22ec061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:12.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.378+0000 7f22f319b6c0 1 -- 10.20.193.40:0/4071780881 shutdown_connections 2026-02-13T01:24:12.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.378+0000 7f22f319b6c0 1 -- 10.20.193.40:0/4071780881 wait complete. 2026-02-13T01:24:12.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.379+0000 7f22f319b6c0 1 Processor -- start 2026-02-13T01:24:12.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.379+0000 7f22f319b6c0 1 -- start start 2026-02-13T01:24:12.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.379+0000 7f22f319b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f22ec1137a0 0x7f22ec1213d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:12.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.379+0000 7f22f319b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec116520 0x7f22ec121910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:12.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.379+0000 7f22f319b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f22ec126c80 0x7f22ec127120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:12.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.379+0000 7f22f319b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec127690 con 0x7f22ec116520 2026-02-13T01:24:12.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.379+0000 7f22f319b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec127800 con 0x7f22ec126c80 2026-02-13T01:24:12.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.379+0000 7f22f319b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec1279c0 con 0x7f22ec1137a0 2026-02-13T01:24:12.382 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f19986c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec116520 0x7f22ec121910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f21996c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f22ec1137a0 0x7f22ec1213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f19986c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec116520 0x7f22ec121910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:43116/0 (socket says 10.20.193.40:43116) 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f19986c0 1 -- 10.20.193.40:0/3115437577 learned_addr learned my addr 10.20.193.40:0/3115437577 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f299a6c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f22ec126c80 0x7f22ec127120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f19986c0 1 -- 10.20.193.40:0/3115437577 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f22ec1137a0 msgr2=0x7f22ec1213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f19986c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f22ec1137a0 0x7f22ec1213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f19986c0 1 -- 10.20.193.40:0/3115437577 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f22ec126c80 msgr2=0x7f22ec127120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f19986c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f22ec126c80 0x7f22ec127120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f19986c0 1 -- 10.20.193.40:0/3115437577 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e0009590 con 0x7f22ec116520 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f19986c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec116520 0x7f22ec121910 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22e002f230 tx=0x7f22e002f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22d37fe6c0 1 -- 10.20.193.40:0/3115437577 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22e00026b0 con 0x7f22ec116520 2026-02-13T01:24:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22d37fe6c0 1 -- 10.20.193.40:0/3115437577 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f22e0002d40 con 0x7f22ec116520 2026-02-13T01:24:12.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22d37fe6c0 1 -- 10.20.193.40:0/3115437577 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22e0007670 con 0x7f22ec116520 2026-02-13T01:24:12.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec167e10 con 0x7f22ec116520 2026-02-13T01:24:12.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.380+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec168240 con 0x7f22ec116520 2026-02-13T01:24:12.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.381+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ec114840 con 0x7f22ec116520 2026-02-13T01:24:12.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.383+0000 7f22d37fe6c0 1 -- 10.20.193.40:0/3115437577 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f22e0002810 con 0x7f22ec116520 2026-02-13T01:24:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.385+0000 7f22d37fe6c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f22c80b5760 0x7f22c80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.385+0000 7f22d37fe6c0 1 -- 10.20.193.40:0/3115437577 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f22e0107d50 con 0x7f22ec116520 2026-02-13T01:24:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.385+0000 7f22d37fe6c0 1 -- 10.20.193.40:0/3115437577 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f22e01081d0 con 0x7f22ec116520 2026-02-13T01:24:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.385+0000 7f22f21996c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f22c80b5760 0x7f22c80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:12.387 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.385+0000 7f22f21996c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f22c80b5760 0x7f22c80d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22dc004750 tx=0x7f22dc009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:12.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:12 trial055 ceph-mon[27509]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:12.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:12 trial118 ceph-mon[27812]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:12.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.512+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f22ec113b70 con 0x7f22ec116520 2026-02-13T01:24:12.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.512+0000 7f22d37fe6c0 1 -- 10.20.193.40:0/3115437577 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f22e00ca6a0 con 0x7f22ec116520 2026-02-13T01:24:12.513 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:12.514 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f22c80b5760 msgr2=0x7f22c80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f22c80b5760 0x7f22c80d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22dc004750 tx=0x7f22dc009390 comp rx=0 tx=0).stop 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec116520 msgr2=0x7f22ec121910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec116520 0x7f22ec121910 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22e002f230 tx=0x7f22e002f830 comp rx=0 tx=0).stop 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 shutdown_connections 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f22c80b5760 0x7f22c80d5c10 unknown :-1 s=CLOSED pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f22ec126c80 0x7f22ec127120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec116520 0x7f22ec121910 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 --2- 10.20.193.40:0/3115437577 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f22ec1137a0 0x7f22ec1213d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 >> 10.20.193.40:0/3115437577 conn(0x7f22ec061510 msgr2=0x7f22ec116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:12.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 shutdown_connections 2026-02-13T01:24:12.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:12.513+0000 7f22f319b6c0 1 -- 10.20.193.40:0/3115437577 wait complete. 2026-02-13T01:24:13.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:13 trial055 ceph-mon[27509]: from='client.25009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:13.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:13 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3115437577' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:13.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:13 trial055 ceph-mon[27509]: pgmap v186: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2026-02-13T01:24:13.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:13 trial040 ceph-mon[23046]: from='client.25009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:13.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:13 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3115437577' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:13.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:13 trial040 ceph-mon[23046]: pgmap v186: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2026-02-13T01:24:13.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:13 trial118 ceph-mon[27812]: from='client.25009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:24:13.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:13 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3115437577' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:13.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:13 trial118 ceph-mon[27812]: pgmap v186: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2026-02-13T01:24:15.617 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:15.802 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:15.932 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:15 trial040 ceph-mon[23046]: pgmap v187: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2026-02-13T01:24:15.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.986+0000 7fa945d376c0 1 -- 10.20.193.40:0/2656522267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010eb20 msgr2=0x7fa94010efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:15.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.986+0000 7fa945d376c0 1 --2- 10.20.193.40:0/2656522267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010eb20 0x7fa94010efc0 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=13974457940441337405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa93c00aa40 tx=0x7fa93c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:15.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.987+0000 7fa945d376c0 1 -- 10.20.193.40:0/2656522267 shutdown_connections 2026-02-13T01:24:15.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.987+0000 7fa945d376c0 1 --2- 10.20.193.40:0/2656522267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010eb20 0x7fa94010efc0 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=13974457940441337405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:15.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.987+0000 7fa945d376c0 1 --2- 10.20.193.40:0/2656522267 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa94010ba80 0x7fa94010e450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:15.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.987+0000 7fa945d376c0 1 --2- 10.20.193.40:0/2656522267 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa94010b170 0x7fa94010b540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:15.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.987+0000 7fa945d376c0 1 -- 10.20.193.40:0/2656522267 >> 10.20.193.40:0/2656522267 conn(0x7fa940063d50 msgr2=0x7fa940109470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:15.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.987+0000 7fa945d376c0 1 -- 10.20.193.40:0/2656522267 shutdown_connections 2026-02-13T01:24:15.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.987+0000 7fa945d376c0 1 -- 10.20.193.40:0/2656522267 wait complete. 2026-02-13T01:24:15.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.987+0000 7fa945d376c0 1 Processor -- start 2026-02-13T01:24:15.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa945d376c0 1 -- start start 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa945d376c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010b170 0x7fa940121e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa945d376c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa94010ba80 0x7fa9401223c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa945d376c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa94010eb20 0x7fa940127780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa945d376c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa940127dd0 con 0x7fa94010b170 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa945d376c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa940127f40 con 0x7fa94010eb20 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa945d376c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa940128100 con 0x7fa94010ba80 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa944d356c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010b170 0x7fa940121e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa937fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa94010ba80 0x7fa9401223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa944d356c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010b170 0x7fa940121e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:43138/0 (socket says 10.20.193.40:43138) 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa944d356c0 1 -- 10.20.193.40:0/4120509730 learned_addr learned my addr 10.20.193.40:0/4120509730 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:15.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa9455366c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa94010eb20 0x7fa940127780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa944d356c0 1 -- 10.20.193.40:0/4120509730 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa94010ba80 msgr2=0x7fa9401223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa944d356c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa94010ba80 0x7fa9401223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa944d356c0 1 -- 10.20.193.40:0/4120509730 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa94010eb20 msgr2=0x7fa940127780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa944d356c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa94010eb20 0x7fa940127780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.988+0000 7fa944d356c0 1 -- 10.20.193.40:0/4120509730 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93c00a660 con 0x7fa94010b170 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.989+0000 7fa944d356c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010b170 0x7fa940121e80 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa930009490 tx=0x7fa93000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.989+0000 7fa935ffb6c0 1 -- 10.20.193.40:0/4120509730 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa930004a80 con 0x7fa94010b170 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.989+0000 7fa935ffb6c0 1 -- 10.20.193.40:0/4120509730 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa930009030 con 0x7fa94010b170 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.989+0000 7fa935ffb6c0 1 -- 10.20.193.40:0/4120509730 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa930007440 con 0x7fa94010b170 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.989+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9401283e0 con 0x7fa94010b170 2026-02-13T01:24:15.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.989+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa940168ac0 con 0x7fa94010b170 2026-02-13T01:24:15.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.989+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa940128600 con 0x7fa94010b170 2026-02-13T01:24:15.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.994+0000 7fa935ffb6c0 1 -- 10.20.193.40:0/4120509730 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa9300075d0 con 0x7fa94010b170 2026-02-13T01:24:15.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.995+0000 7fa935ffb6c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa91c0b5760 0x7fa91c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:15.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.996+0000 7fa935ffb6c0 1 -- 10.20.193.40:0/4120509730 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fa9300e3ba0 con 0x7fa94010b170 2026-02-13T01:24:15.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.996+0000 7fa935ffb6c0 1 -- 10.20.193.40:0/4120509730 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa93011c600 con 0x7fa94010b170 2026-02-13T01:24:15.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.996+0000 7fa937fff6c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa91c0b5760 0x7fa91c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:15.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:15.997+0000 7fa937fff6c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa91c0b5760 0x7fa91c0d5c10 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa940128810 tx=0x7fa928009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:16.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:15 trial118 ceph-mon[27812]: pgmap v187: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2026-02-13T01:24:16.122 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.121+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa94010bf40 con 0x7fa94010b170 2026-02-13T01:24:16.123 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.121+0000 7fa935ffb6c0 1 -- 10.20.193.40:0/4120509730 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa9300a64f0 con 0x7fa94010b170 2026-02-13T01:24:16.123 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:16.123 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:16.124 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.122+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa91c0b5760 msgr2=0x7fa91c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:16.124 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.122+0000 7fa945d376c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa91c0b5760 0x7fa91c0d5c10 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa940128810 tx=0x7fa928009260 comp rx=0 tx=0).stop 2026-02-13T01:24:16.124 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.122+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010b170 msgr2=0x7fa940121e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:16.124 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.122+0000 7fa945d376c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010b170 0x7fa940121e80 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa930009490 tx=0x7fa93000bca0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.124 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.123+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 shutdown_connections 2026-02-13T01:24:16.124 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.123+0000 7fa945d376c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa91c0b5760 0x7fa91c0d5c10 unknown :-1 s=CLOSED pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.124 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.123+0000 7fa945d376c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa94010eb20 0x7fa940127780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.123+0000 7fa945d376c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa94010ba80 0x7fa9401223c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.123+0000 7fa945d376c0 1 --2- 10.20.193.40:0/4120509730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa94010b170 0x7fa940121e80 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.123+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 >> 10.20.193.40:0/4120509730 conn(0x7fa940063d50 msgr2=0x7fa94010cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:16.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.123+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 shutdown_connections 2026-02-13T01:24:16.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:16.123+0000 7fa945d376c0 1 -- 10.20.193.40:0/4120509730 wait complete. 2026-02-13T01:24:16.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:15 trial055 ceph-mon[27509]: pgmap v187: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2026-02-13T01:24:17.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:16 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4120509730' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:17.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:16 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4120509730' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:17.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:16 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4120509730' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:18.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:17 trial118 ceph-mon[27812]: pgmap v188: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2026-02-13T01:24:18.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:17 trial055 ceph-mon[27509]: pgmap v188: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2026-02-13T01:24:18.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:17 trial040 ceph-mon[23046]: pgmap v188: 97 pgs: 97 active+clean; 646 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2026-02-13T01:24:19.228 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:19.417 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:19.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.624+0000 7f7d3bfff6c0 1 -- 10.20.193.40:0/3683543046 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 msgr2=0x7f7d3c111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:19.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.624+0000 7f7d3bfff6c0 1 --2- 10.20.193.40:0/3683543046 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 0x7f7d3c111700 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=17174903659371186766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d2c00aa40 tx=0x7f7d2c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.624+0000 7f7d3bfff6c0 1 -- 10.20.193.40:0/3683543046 shutdown_connections 2026-02-13T01:24:19.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.624+0000 7f7d3bfff6c0 1 --2- 10.20.193.40:0/3683543046 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 0x7f7d3c111700 unknown :-1 s=CLOSED pgs=244 gs=1 cs=0 l=1 c_cookie=17174903659371186766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.624+0000 7f7d3bfff6c0 1 --2- 10.20.193.40:0/3683543046 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7d3c10b730 0x7f7d3c110590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.624+0000 7f7d3bfff6c0 1 --2- 10.20.193.40:0/3683543046 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7d3c10ad40 0x7f7d3c10b110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.626 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.624+0000 7f7d3bfff6c0 1 -- 10.20.193.40:0/3683543046 >> 10.20.193.40:0/3683543046 conn(0x7f7d3c0638a0 msgr2=0x7f7d3c109040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:19.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.624+0000 7f7d3bfff6c0 1 -- 10.20.193.40:0/3683543046 shutdown_connections 2026-02-13T01:24:19.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.624+0000 7f7d3bfff6c0 1 -- 10.20.193.40:0/3683543046 wait complete. 2026-02-13T01:24:19.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3bfff6c0 1 Processor -- start 2026-02-13T01:24:19.627 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3bfff6c0 1 -- start start 2026-02-13T01:24:19.628 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3bfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7d3c10ad40 0x7f7d3c122300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3bfff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 0x7f7d3c122840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3bfff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7d3c127c00 0x7f7d3c1280a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3bfff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c128610 con 0x7f7d3c110d40 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3bfff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c128780 con 0x7f7d3c10ad40 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3bfff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c128940 con 0x7f7d3c127c00 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3a7fc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 0x7f7d3c122840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3a7fc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 0x7f7d3c122840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:43154/0 (socket says 10.20.193.40:43154) 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3b7fe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7d3c127c00 0x7f7d3c1280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3affd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7d3c10ad40 0x7f7d3c122300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.625+0000 7f7d3a7fc6c0 1 -- 10.20.193.40:0/1949754651 learned_addr learned my addr 10.20.193.40:0/1949754651 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:19.629 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d3a7fc6c0 1 -- 10.20.193.40:0/1949754651 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7d3c127c00 msgr2=0x7f7d3c1280a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d3a7fc6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7d3c127c00 0x7f7d3c1280a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d3a7fc6c0 1 -- 10.20.193.40:0/1949754651 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7d3c10ad40 msgr2=0x7f7d3c122300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d3a7fc6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7d3c10ad40 0x7f7d3c122300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d3a7fc6c0 1 -- 10.20.193.40:0/1949754651 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c00a660 con 0x7f7d3c110d40 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d3a7fc6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 0x7f7d3c122840 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d2400b800 tx=0x7f7d2400bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d1bfff6c0 1 -- 10.20.193.40:0/1949754651 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d24004a80 con 0x7f7d3c110d40 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d1bfff6c0 1 -- 10.20.193.40:0/1949754651 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7d24009070 con 0x7f7d3c110d40 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d1bfff6c0 1 -- 10.20.193.40:0/1949754651 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d240071c0 con 0x7f7d3c110d40 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d3bfff6c0 1 -- 10.20.193.40:0/1949754651 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3c168df0 con 0x7f7d3c110d40 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.626+0000 7f7d3bfff6c0 1 -- 10.20.193.40:0/1949754651 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3c169280 con 0x7f7d3c110d40 2026-02-13T01:24:19.630 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.627+0000 7f7d19ffb6c0 1 -- 10.20.193.40:0/1949754651 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3c10be30 con 0x7f7d3c110d40 2026-02-13T01:24:19.631 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.629+0000 7f7d1bfff6c0 1 -- 10.20.193.40:0/1949754651 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7d24004070 con 0x7f7d3c110d40 2026-02-13T01:24:19.632 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.630+0000 7f7d1bfff6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7d100b5760 0x7f7d100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:19.632 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.630+0000 7f7d1bfff6c0 1 -- 10.20.193.40:0/1949754651 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f7d240e3ad0 con 0x7f7d3c110d40 2026-02-13T01:24:19.632 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.630+0000 7f7d3affd6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7d100b5760 0x7f7d100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:19.632 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.630+0000 7f7d1bfff6c0 1 -- 10.20.193.40:0/1949754651 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7d2411c5e0 con 0x7f7d3c110d40 2026-02-13T01:24:19.632 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.631+0000 7f7d3affd6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7d100b5760 0x7f7d100d5c10 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d30004750 tx=0x7f7d30009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:19.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.756+0000 7f7d19ffb6c0 1 -- 10.20.193.40:0/1949754651 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7d3c123450 con 0x7f7d3c110d40 2026-02-13T01:24:19.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.756+0000 7f7d1bfff6c0 1 -- 10.20.193.40:0/1949754651 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7d240a6420 con 0x7f7d3c110d40 2026-02-13T01:24:19.757 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:19.758 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 -- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7d100b5760 msgr2=0x7f7d100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7d100b5760 0x7f7d100d5c10 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d30004750 tx=0x7f7d30009390 comp rx=0 tx=0).stop 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 -- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 msgr2=0x7f7d3c122840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 0x7f7d3c122840 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d2400b800 tx=0x7f7d2400bcd0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 -- 10.20.193.40:0/1949754651 shutdown_connections 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7d100b5760 0x7f7d100d5c10 unknown :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7d3c127c00 0x7f7d3c1280a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7d3c110d40 0x7f7d3c122840 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 --2- 10.20.193.40:0/1949754651 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7d3c10ad40 0x7f7d3c122300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 -- 10.20.193.40:0/1949754651 >> 10.20.193.40:0/1949754651 conn(0x7f7d3c0638a0 msgr2=0x7f7d3c10ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:19.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 -- 10.20.193.40:0/1949754651 shutdown_connections 2026-02-13T01:24:19.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:19.757+0000 7f7d19ffb6c0 1 -- 10.20.193.40:0/1949754651 wait complete. 2026-02-13T01:24:19.788 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:19 trial040 ceph-mon[23046]: pgmap v189: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2026-02-13T01:24:20.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:19 trial055 ceph-mon[27509]: pgmap v189: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2026-02-13T01:24:20.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:19 trial118 ceph-mon[27812]: pgmap v189: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2026-02-13T01:24:21.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:20 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1949754651' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:21.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:20 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1949754651' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:21.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:20 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1949754651' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:22.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:21 trial055 ceph-mon[27509]: pgmap v190: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-13T01:24:22.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:21 trial040 ceph-mon[23046]: pgmap v190: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-13T01:24:22.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:21 trial118 ceph-mon[27812]: pgmap v190: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-13T01:24:22.862 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:23.048 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:23.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.247+0000 7f0d129206c0 1 -- 10.20.193.40:0/3823062386 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 msgr2=0x7f0d0c175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:23.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.248+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3823062386 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 0x7f0d0c175c10 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=11858388703376904984 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d0800aa70 tx=0x7f0d0802fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.248+0000 7f0d129206c0 1 -- 10.20.193.40:0/3823062386 shutdown_connections 2026-02-13T01:24:23.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.248+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3823062386 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 0x7f0d0c175c10 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=11858388703376904984 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.248+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3823062386 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0d0c10fa50 0x7f0d0c114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.248+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3823062386 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0d0c10f060 0x7f0d0c10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.248+0000 7f0d129206c0 1 -- 10.20.193.40:0/3823062386 >> 10.20.193.40:0/3823062386 conn(0x7f0d0c0ec980 msgr2=0x7f0d0c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:23.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.248+0000 7f0d129206c0 1 -- 10.20.193.40:0/3823062386 shutdown_connections 2026-02-13T01:24:23.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.248+0000 7f0d129206c0 1 -- 10.20.193.40:0/3823062386 wait complete. 2026-02-13T01:24:23.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.248+0000 7f0d129206c0 1 Processor -- start 2026-02-13T01:24:23.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d129206c0 1 -- start start 2026-02-13T01:24:23.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d129206c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0d0c10f060 0x7f0d0c11cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:23.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d129206c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 0x7f0d0c11d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d129206c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0d0c122690 0x7f0d0c122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d129206c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c1230a0 con 0x7f0d0c115270 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d129206c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c123210 con 0x7f0d0c122690 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d129206c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c1233d0 con 0x7f0d0c10f060 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1111d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 0x7f0d0c11d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1191e6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0d0c10f060 0x7f0d0c11cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1111d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 0x7f0d0c11d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:42818/0 (socket says 10.20.193.40:42818) 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1111d6c0 1 -- 10.20.193.40:0/3984779034 learned_addr learned my addr 10.20.193.40:0/3984779034 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1211f6c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0d0c122690 0x7f0d0c122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1111d6c0 1 -- 10.20.193.40:0/3984779034 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0d0c10f060 msgr2=0x7f0d0c11cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1111d6c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0d0c10f060 0x7f0d0c11cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1111d6c0 1 -- 10.20.193.40:0/3984779034 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0d0c122690 msgr2=0x7f0d0c122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1111d6c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0d0c122690 0x7f0d0c122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1111d6c0 1 -- 10.20.193.40:0/3984779034 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0800a660 con 0x7f0d0c115270 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.249+0000 7f0d1211f6c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0d0c122690 0x7f0d0c122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.250+0000 7f0d1111d6c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 0x7f0d0c11d2d0 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d0000b750 tx=0x7f0d0000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.250+0000 7f0cfaffd6c0 1 -- 10.20.193.40:0/3984779034 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d00004a80 con 0x7f0d0c115270 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.250+0000 7f0cfaffd6c0 1 -- 10.20.193.40:0/3984779034 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0d00009030 con 0x7f0d0c115270 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.250+0000 7f0cfaffd6c0 1 -- 10.20.193.40:0/3984779034 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d000071c0 con 0x7f0d0c115270 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.250+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c163880 con 0x7f0d0c115270 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.250+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c163ce0 con 0x7f0d0c115270 2026-02-13T01:24:23.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.251+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0c110330 con 0x7f0d0c115270 2026-02-13T01:24:23.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.253+0000 7f0cfaffd6c0 1 -- 10.20.193.40:0/3984779034 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f0d000026b0 con 0x7f0d0c115270 2026-02-13T01:24:23.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.254+0000 7f0cfaffd6c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ce80b5760 0x7f0ce80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:23.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.255+0000 7f0cfaffd6c0 1 -- 10.20.193.40:0/3984779034 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f0d000e3cd0 con 0x7f0d0c115270 2026-02-13T01:24:23.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.255+0000 7f0d1191e6c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ce80b5760 0x7f0ce80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:23.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.255+0000 7f0cfaffd6c0 1 -- 10.20.193.40:0/3984779034 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0d000e4150 con 0x7f0d0c115270 2026-02-13T01:24:23.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.255+0000 7f0d1191e6c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ce80b5760 0x7f0ce80d5c10 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cfc004750 tx=0x7f0cfc009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:23.381 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.380+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0d0c10f430 con 0x7f0d0c115270 2026-02-13T01:24:23.381 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.380+0000 7f0cfaffd6c0 1 -- 10.20.193.40:0/3984779034 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0d000a6620 con 0x7f0d0c115270 2026-02-13T01:24:23.382 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:23.382 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ce80b5760 msgr2=0x7f0ce80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ce80b5760 0x7f0ce80d5c10 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cfc004750 tx=0x7f0cfc009260 comp rx=0 tx=0).stop 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 msgr2=0x7f0d0c11d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 0x7f0d0c11d2d0 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d0000b750 tx=0x7f0d0000bc20 comp rx=0 tx=0).stop 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 shutdown_connections 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0ce80b5760 0x7f0ce80d5c10 unknown :-1 s=CLOSED pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0d0c122690 0x7f0d0c122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d0c115270 0x7f0d0c11d2d0 unknown :-1 s=CLOSED pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 --2- 10.20.193.40:0/3984779034 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0d0c10f060 0x7f0d0c11cd90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 >> 10.20.193.40:0/3984779034 conn(0x7f0d0c0ec980 msgr2=0x7f0d0c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:23.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 shutdown_connections 2026-02-13T01:24:23.384 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:23.381+0000 7f0d129206c0 1 -- 10.20.193.40:0/3984779034 wait complete. 2026-02-13T01:24:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:23 trial055 ceph-mon[27509]: pgmap v191: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-13T01:24:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:23 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3984779034' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:23 trial040 ceph-mon[23046]: pgmap v191: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-13T01:24:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:23 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3984779034' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:24.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:23 trial118 ceph-mon[27812]: pgmap v191: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-13T01:24:24.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:23 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3984779034' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:26.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:25 trial055 ceph-mon[27509]: pgmap v192: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-13T01:24:26.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:25 trial040 ceph-mon[23046]: pgmap v192: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-13T01:24:26.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:25 trial118 ceph-mon[27812]: pgmap v192: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-13T01:24:26.523 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:26.707 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:26.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 -- 10.20.193.40:0/3802082063 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10fa50 msgr2=0x7fc30c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:26.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 --2- 10.20.193.40:0/3802082063 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10fa50 0x7fc30c114a90 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=16001127551839556856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3000099a0 tx=0x7fc30002ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:26.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 -- 10.20.193.40:0/3802082063 shutdown_connections 2026-02-13T01:24:26.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 --2- 10.20.193.40:0/3802082063 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc30c115270 0x7fc30c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:26.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 --2- 10.20.193.40:0/3802082063 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10fa50 0x7fc30c114a90 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=16001127551839556856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:26.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 --2- 10.20.193.40:0/3802082063 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc30c10f060 0x7fc30c10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:26.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 -- 10.20.193.40:0/3802082063 >> 10.20.193.40:0/3802082063 conn(0x7fc30c0ec980 msgr2=0x7fc30c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:26.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 -- 10.20.193.40:0/3802082063 shutdown_connections 2026-02-13T01:24:26.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 -- 10.20.193.40:0/3802082063 wait complete. 2026-02-13T01:24:26.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 Processor -- start 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.901+0000 7fc3122526c0 1 -- start start 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3122526c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10f060 0x7fc30c0f4860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3122526c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc30c115270 0x7fc30c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3122526c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc30c0f4e90 0x7fc30c0fa160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3122526c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c0f5580 con 0x7fc30c10f060 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3122526c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c0fa6a0 con 0x7fc30c0f4e90 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3122526c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c0fa860 con 0x7fc30c115270 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3112506c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10f060 0x7fc30c0f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc310a4f6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc30c115270 0x7fc30c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3112506c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10f060 0x7fc30c0f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:42840/0 (socket says 10.20.193.40:42840) 2026-02-13T01:24:26.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3112506c0 1 -- 10.20.193.40:0/1388556722 learned_addr learned my addr 10.20.193.40:0/1388556722 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc310a4f6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc30c115270 0x7fc30c175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:45170/0 (socket says 10.20.193.40:45170) 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc311a516c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc30c0f4e90 0x7fc30c0fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3112506c0 1 -- 10.20.193.40:0/1388556722 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc30c115270 msgr2=0x7fc30c175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3112506c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc30c115270 0x7fc30c175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3112506c0 1 -- 10.20.193.40:0/1388556722 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc30c0f4e90 msgr2=0x7fc30c0fa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3112506c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc30c0f4e90 0x7fc30c0fa160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3112506c0 1 -- 10.20.193.40:0/1388556722 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc300009590 con 0x7fc30c10f060 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc3112506c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10f060 0x7fc30c0f4860 secure :-1 s=READY pgs=249 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2fc009490 tx=0x7fc2fc00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc2fa7fc6c0 1 -- 10.20.193.40:0/1388556722 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2fc004a80 con 0x7fc30c10f060 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc2fa7fc6c0 1 -- 10.20.193.40:0/1388556722 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc2fc009030 con 0x7fc30c10f060 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.902+0000 7fc2fa7fc6c0 1 -- 10.20.193.40:0/1388556722 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2fc007440 con 0x7fc30c10f060 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.903+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30c0fab40 con 0x7fc30c10f060 2026-02-13T01:24:26.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.903+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30c0fafd0 con 0x7fc30c10f060 2026-02-13T01:24:26.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.903+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30c110330 con 0x7fc30c10f060 2026-02-13T01:24:26.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.905+0000 7fc2fa7fc6c0 1 -- 10.20.193.40:0/1388556722 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc2fc004be0 con 0x7fc30c10f060 2026-02-13T01:24:26.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.907+0000 7fc2fa7fc6c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc2e80b5760 0x7fc2e80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:26.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.907+0000 7fc2fa7fc6c0 1 -- 10.20.193.40:0/1388556722 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fc2fc0e3910 con 0x7fc30c10f060 2026-02-13T01:24:26.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.907+0000 7fc310a4f6c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc2e80b5760 0x7fc2e80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:26.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.907+0000 7fc2fa7fc6c0 1 -- 10.20.193.40:0/1388556722 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc2fc0e3d90 con 0x7fc30c10f060 2026-02-13T01:24:26.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:26.908+0000 7fc310a4f6c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc2e80b5760 0x7fc2e80d5c10 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc30c0fb1f0 tx=0x7fc3000023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:27.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.032+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc30c10f430 con 0x7fc30c10f060 2026-02-13T01:24:27.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.032+0000 7fc2fa7fc6c0 1 -- 10.20.193.40:0/1388556722 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc2fc0a6260 con 0x7fc30c10f060 2026-02-13T01:24:27.034 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:27.034 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc2e80b5760 msgr2=0x7fc2e80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc2e80b5760 0x7fc2e80d5c10 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc30c0fb1f0 tx=0x7fc3000023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10f060 msgr2=0x7fc30c0f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10f060 0x7fc30c0f4860 secure :-1 s=READY pgs=249 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2fc009490 tx=0x7fc2fc00bca0 comp rx=0 tx=0).stop 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 shutdown_connections 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc2e80b5760 0x7fc2e80d5c10 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc30c0f4e90 0x7fc30c0fa160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc30c115270 0x7fc30c175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 --2- 10.20.193.40:0/1388556722 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc30c10f060 0x7fc30c0f4860 unknown :-1 s=CLOSED pgs=249 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 >> 10.20.193.40:0/1388556722 conn(0x7fc30c0ec980 msgr2=0x7fc30c10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:27.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 shutdown_connections 2026-02-13T01:24:27.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:27.033+0000 7fc3122526c0 1 -- 10.20.193.40:0/1388556722 wait complete. 2026-02-13T01:24:28.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:27 trial055 ceph-mon[27509]: pgmap v193: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-13T01:24:28.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:27 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1388556722' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:28.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:27 trial040 ceph-mon[23046]: pgmap v193: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-13T01:24:28.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:27 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1388556722' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:28.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:27 trial118 ceph-mon[27812]: pgmap v193: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-13T01:24:28.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:27 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1388556722' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:30.137 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:30.190 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:29 trial040 ceph-mon[23046]: pgmap v194: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-13T01:24:30.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:29 trial055 ceph-mon[27509]: pgmap v194: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-13T01:24:30.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:29 trial118 ceph-mon[27812]: pgmap v194: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-13T01:24:30.324 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:30.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.510+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/4033417019 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998114190 msgr2=0x7fd998115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:30.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.510+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/4033417019 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998114190 0x7fd998115d40 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=4176998795076628734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9880099a0 tx=0x7fd98802ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:30.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.510+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/4033417019 shutdown_connections 2026-02-13T01:24:30.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.510+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/4033417019 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd998116520 0x7fd99817a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.510+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/4033417019 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998114190 0x7fd998115d40 unknown :-1 s=CLOSED pgs=250 gs=1 cs=0 l=1 c_cookie=4176998795076628734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.510+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/4033417019 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd9981137a0 0x7fd998113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.510+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/4033417019 >> 10.20.193.40:0/4033417019 conn(0x7fd998061510 msgr2=0x7fd998061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:30.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.510+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/4033417019 shutdown_connections 2026-02-13T01:24:30.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.510+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/4033417019 wait complete. 2026-02-13T01:24:30.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.511+0000 7fd99d0eb6c0 1 Processor -- start 2026-02-13T01:24:30.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.511+0000 7fd99d0eb6c0 1 -- start start 2026-02-13T01:24:30.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd99d0eb6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd9981137a0 0x7fd998121430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:30.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd99d0eb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998116520 0x7fd998121970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:30.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd99d0eb6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd998126d30 0x7fd9981271d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:30.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd99d0eb6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd998127740 con 0x7fd998116520 2026-02-13T01:24:30.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd99d0eb6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd9981278b0 con 0x7fd9981137a0 2026-02-13T01:24:30.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd99d0eb6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd998127a70 con 0x7fd998126d30 2026-02-13T01:24:30.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9977fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998116520 0x7fd998121970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd997fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd9981137a0 0x7fd998121430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9977fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998116520 0x7fd998121970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:59006/0 (socket says 10.20.193.40:59006) 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9977fe6c0 1 -- 10.20.193.40:0/212043187 learned_addr learned my addr 10.20.193.40:0/212043187 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd99c8ea6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd998126d30 0x7fd9981271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9977fe6c0 1 -- 10.20.193.40:0/212043187 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd998126d30 msgr2=0x7fd9981271d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9977fe6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd998126d30 0x7fd9981271d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9977fe6c0 1 -- 10.20.193.40:0/212043187 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd9981137a0 msgr2=0x7fd998121430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9977fe6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd9981137a0 0x7fd998121430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9977fe6c0 1 -- 10.20.193.40:0/212043187 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd988009590 con 0x7fd998116520 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9977fe6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998116520 0x7fd998121970 secure :-1 s=READY pgs=251 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9880092e0 tx=0x7fd98802f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9957fa6c0 1 -- 10.20.193.40:0/212043187 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9880046b0 con 0x7fd998116520 2026-02-13T01:24:30.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9957fa6c0 1 -- 10.20.193.40:0/212043187 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd988002be0 con 0x7fd998116520 2026-02-13T01:24:30.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd9957fa6c0 1 -- 10.20.193.40:0/212043187 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9880073f0 con 0x7fd998116520 2026-02-13T01:24:30.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.512+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd998167ec0 con 0x7fd998116520 2026-02-13T01:24:30.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.513+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9981682f0 con 0x7fd998116520 2026-02-13T01:24:30.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.513+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd998114840 con 0x7fd998116520 2026-02-13T01:24:30.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.515+0000 7fd9957fa6c0 1 -- 10.20.193.40:0/212043187 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fd9880026b0 con 0x7fd998116520 2026-02-13T01:24:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.517+0000 7fd9957fa6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd96c0b5760 0x7fd96c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.517+0000 7fd9957fa6c0 1 -- 10.20.193.40:0/212043187 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7fd988107c50 con 0x7fd998116520 2026-02-13T01:24:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.517+0000 7fd9957fa6c0 1 -- 10.20.193.40:0/212043187 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd9881080d0 con 0x7fd998116520 2026-02-13T01:24:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.518+0000 7fd997fff6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd96c0b5760 0x7fd96c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.518+0000 7fd997fff6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd96c0b5760 0x7fd96c0d5c10 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd984004750 tx=0x7fd984009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:30.646 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.644+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd9981225e0 con 0x7fd998116520 2026-02-13T01:24:30.646 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.645+0000 7fd9957fa6c0 1 -- 10.20.193.40:0/212043187 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd9880ca5a0 con 0x7fd998116520 2026-02-13T01:24:30.646 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:30.647 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:30.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd96c0b5760 msgr2=0x7fd96c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:30.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd96c0b5760 0x7fd96c0d5c10 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd984004750 tx=0x7fd984009390 comp rx=0 tx=0).stop 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998116520 msgr2=0x7fd998121970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998116520 0x7fd998121970 secure :-1 s=READY pgs=251 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9880092e0 tx=0x7fd98802f810 comp rx=0 tx=0).stop 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 shutdown_connections 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd96c0b5760 0x7fd96c0d5c10 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd998126d30 0x7fd9981271d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd998116520 0x7fd998121970 unknown :-1 s=CLOSED pgs=251 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 --2- 10.20.193.40:0/212043187 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd9981137a0 0x7fd998121430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 >> 10.20.193.40:0/212043187 conn(0x7fd998061510 msgr2=0x7fd998116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 shutdown_connections 2026-02-13T01:24:30.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:30.646+0000 7fd99d0eb6c0 1 -- 10.20.193.40:0/212043187 wait complete. 2026-02-13T01:24:30.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:30 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/212043187' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:31.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:30 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/212043187' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:31.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:30 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/212043187' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:32.154 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:31 trial118 ceph-mon[27812]: pgmap v195: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:24:32.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:31 trial055 ceph-mon[27509]: pgmap v195: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:24:32.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:31 trial040 ceph-mon[23046]: pgmap v195: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:24:33.752 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:33.937 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:34.039 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:33 trial040 ceph-mon[23046]: pgmap v196: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:24:34.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.132+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/1368522952 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f08a010fbf0 msgr2=0x7f08a0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:34.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.132+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/1368522952 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f08a010fbf0 0x7f08a0114c30 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=18316396158513351997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08940099a0 tx=0x7f089402ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:34.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.132+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/1368522952 shutdown_connections 2026-02-13T01:24:34.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.132+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/1368522952 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f08a0115410 0x7f08a0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:34.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.132+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/1368522952 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f08a010fbf0 0x7f08a0114c30 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=18316396158513351997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:34.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.132+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/1368522952 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f08a010f200 0x7f08a010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:34.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.132+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/1368522952 >> 10.20.193.40:0/1368522952 conn(0x7f08a00ecb00 msgr2=0x7f08a010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:34.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.132+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/1368522952 shutdown_connections 2026-02-13T01:24:34.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.132+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/1368522952 wait complete. 2026-02-13T01:24:34.136 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a72bc6c0 1 Processor -- start 2026-02-13T01:24:34.136 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a72bc6c0 1 -- start start 2026-02-13T01:24:34.136 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a72bc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f08a010f200 0x7f08a011d090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:34.136 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a72bc6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f08a0115410 0x7f08a011d5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:34.136 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a72bc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f08a0122990 0x7f08a0122e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:34.136 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a72bc6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f08a01233a0 con 0x7f08a010f200 2026-02-13T01:24:34.136 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a72bc6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f08a0123510 con 0x7f08a0122990 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a72bc6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f08a01236d0 con 0x7f08a0115410 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a58326c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f08a0122990 0x7f08a0122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a48306c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f08a0115410 0x7f08a011d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a58326c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f08a0122990 0x7f08a0122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:41122/0 (socket says 10.20.193.40:41122) 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.133+0000 7f08a58326c0 1 -- 10.20.193.40:0/2739294160 learned_addr learned my addr 10.20.193.40:0/2739294160 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a50316c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f08a010f200 0x7f08a011d090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a58326c0 1 -- 10.20.193.40:0/2739294160 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f08a0115410 msgr2=0x7f08a011d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a58326c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f08a0115410 0x7f08a011d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a58326c0 1 -- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f08a010f200 msgr2=0x7f08a011d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a58326c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f08a010f200 0x7f08a011d090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:34.137 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a58326c0 1 -- 10.20.193.40:0/2739294160 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0894009590 con 0x7f08a0122990 2026-02-13T01:24:34.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a50316c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f08a010f200 0x7f08a011d090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:34.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a58326c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f08a0122990 0x7f08a0122e30 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f089c006ea0 tx=0x7f089c00ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:34.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f088e7fc6c0 1 -- 10.20.193.40:0/2739294160 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f089c003c40 con 0x7f08a0122990 2026-02-13T01:24:34.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f088e7fc6c0 1 -- 10.20.193.40:0/2739294160 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f089c003da0 con 0x7f08a0122990 2026-02-13T01:24:34.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f088e7fc6c0 1 -- 10.20.193.40:0/2739294160 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f089c008440 con 0x7f08a0122990 2026-02-13T01:24:34.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a0163b80 con 0x7f08a0122990 2026-02-13T01:24:34.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.134+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a0164060 con 0x7f08a0122990 2026-02-13T01:24:34.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.135+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a01104d0 con 0x7f08a0122990 2026-02-13T01:24:34.138 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.137+0000 7f088e7fc6c0 1 -- 10.20.193.40:0/2739294160 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f089c00d690 con 0x7f08a0122990 2026-02-13T01:24:34.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.139+0000 7f088e7fc6c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f087c0b5760 0x7f087c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:34.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.139+0000 7f088e7fc6c0 1 -- 10.20.193.40:0/2739294160 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f089c0e4c90 con 0x7f08a0122990 2026-02-13T01:24:34.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.139+0000 7f08a50316c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f087c0b5760 0x7f087c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:34.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.139+0000 7f088e7fc6c0 1 -- 10.20.193.40:0/2739294160 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f089c0e5110 con 0x7f08a0122990 2026-02-13T01:24:34.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.140+0000 7f08a50316c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f087c0b5760 0x7f087c0d5c10 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0890004750 tx=0x7f0890009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:34.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:33 trial055 ceph-mon[27509]: pgmap v196: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:24:34.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:33 trial118 ceph-mon[27812]: pgmap v196: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:24:34.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.264+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f08a011e1e0 con 0x7f08a0122990 2026-02-13T01:24:34.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.264+0000 7f088e7fc6c0 1 -- 10.20.193.40:0/2739294160 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f089c0a75e0 con 0x7f08a0122990 2026-02-13T01:24:34.266 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:34.266 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:34.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f087c0b5760 msgr2=0x7f087c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:34.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f087c0b5760 0x7f087c0d5c10 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0890004750 tx=0x7f0890009260 comp rx=0 tx=0).stop 2026-02-13T01:24:34.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f08a0122990 msgr2=0x7f08a0122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:34.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f08a0122990 0x7f08a0122e30 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f089c006ea0 tx=0x7f089c00ce50 comp rx=0 tx=0).stop 2026-02-13T01:24:34.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 shutdown_connections 2026-02-13T01:24:34.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f087c0b5760 0x7f087c0d5c10 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:34.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f08a0122990 0x7f08a0122e30 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:34.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f08a0115410 0x7f08a011d5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:34.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 --2- 10.20.193.40:0/2739294160 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f08a010f200 0x7f08a011d090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:34.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 >> 10.20.193.40:0/2739294160 conn(0x7f08a00ecb00 msgr2=0x7f08a010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:34.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.265+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 shutdown_connections 2026-02-13T01:24:34.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:34.266+0000 7f08a72bc6c0 1 -- 10.20.193.40:0/2739294160 wait complete. 2026-02-13T01:24:35.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:34 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2739294160' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:35.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:34 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2739294160' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:35.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:34 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2739294160' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:36.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:35 trial055 ceph-mon[27509]: pgmap v197: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:24:36.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:35 trial040 ceph-mon[23046]: pgmap v197: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:24:36.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:35 trial118 ceph-mon[27812]: pgmap v197: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:24:37.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2026-02-13T01:24:37.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-13T01:24:37.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]} : dispatch 2026-02-13T01:24:37.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]} : dispatch 2026-02-13T01:24:37.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2026-02-13T01:24:37.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2026-02-13T01:24:37.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]} : dispatch 2026-02-13T01:24:37.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2026-02-13T01:24:37.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:36 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2026-02-13T01:24:37.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2026-02-13T01:24:37.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-13T01:24:37.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]} : dispatch 2026-02-13T01:24:37.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]} : dispatch 2026-02-13T01:24:37.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2026-02-13T01:24:37.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2026-02-13T01:24:37.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]} : dispatch 2026-02-13T01:24:37.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2026-02-13T01:24:37.250 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:36 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2026-02-13T01:24:37.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2026-02-13T01:24:37.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-13T01:24:37.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]} : dispatch 2026-02-13T01:24:37.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]} : dispatch 2026-02-13T01:24:37.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2026-02-13T01:24:37.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2026-02-13T01:24:37.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]} : dispatch 2026-02-13T01:24:37.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2026-02-13T01:24:37.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:36 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2026-02-13T01:24:37.371 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:37.557 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:37.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.763+0000 7f21d1d066c0 1 -- 10.20.193.40:0/2086638316 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 msgr2=0x7f21cc10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:37.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.763+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/2086638316 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 0x7f21cc10f430 secure :-1 s=READY pgs=253 gs=2 cs=0 l=1 c_cookie=17689852060729947155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21bc0099a0 tx=0x7f21bc02ed50 comp rx=0 tx=0).stop 2026-02-13T01:24:37.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.763+0000 7f21d1d066c0 1 -- 10.20.193.40:0/2086638316 shutdown_connections 2026-02-13T01:24:37.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.763+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/2086638316 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21cc115270 0x7f21cc175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.763+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/2086638316 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f21cc10fa50 0x7f21cc114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.763+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/2086638316 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 0x7f21cc10f430 unknown :-1 s=CLOSED pgs=253 gs=2 cs=0 l=1 c_cookie=17689852060729947155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.763+0000 7f21d1d066c0 1 -- 10.20.193.40:0/2086638316 >> 10.20.193.40:0/2086638316 conn(0x7f21cc0ec980 msgr2=0x7f21cc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:37.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.764+0000 7f21d1d066c0 1 -- 10.20.193.40:0/2086638316 shutdown_connections 2026-02-13T01:24:37.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.764+0000 7f21d1d066c0 1 -- 10.20.193.40:0/2086638316 wait complete. 2026-02-13T01:24:37.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d1d066c0 1 Processor -- start 2026-02-13T01:24:37.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d1d066c0 1 -- start start 2026-02-13T01:24:37.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d1d066c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 0x7f21cc11ce70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:37.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d1d066c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21cc115270 0x7f21cc11d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:37.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d1d066c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f21cc122770 0x7f21cc122c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:37.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d1d066c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc123180 con 0x7f21cc10f060 2026-02-13T01:24:37.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d1d066c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1232f0 con 0x7f21cc115270 2026-02-13T01:24:37.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d1d066c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1234b0 con 0x7f21cc122770 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d0d046c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 0x7f21cc11ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d0d046c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 0x7f21cc11ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:59038/0 (socket says 10.20.193.40:59038) 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.765+0000 7f21d0d046c0 1 -- 10.20.193.40:0/3814885094 learned_addr learned my addr 10.20.193.40:0/3814885094 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21d15056c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f21cc122770 0x7f21cc122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21c3fff6c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21cc115270 0x7f21cc11d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21d0d046c0 1 -- 10.20.193.40:0/3814885094 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f21cc122770 msgr2=0x7f21cc122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21d0d046c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f21cc122770 0x7f21cc122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21d0d046c0 1 -- 10.20.193.40:0/3814885094 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21cc115270 msgr2=0x7f21cc11d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21d0d046c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21cc115270 0x7f21cc11d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21d0d046c0 1 -- 10.20.193.40:0/3814885094 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21bc009590 con 0x7f21cc10f060 2026-02-13T01:24:37.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21d0d046c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 0x7f21cc11ce70 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21bc0098c0 tx=0x7f21bc02f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:37.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21c1ffb6c0 1 -- 10.20.193.40:0/3814885094 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21bc0046b0 con 0x7f21cc10f060 2026-02-13T01:24:37.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21cc163900 con 0x7f21cc10f060 2026-02-13T01:24:37.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21c1ffb6c0 1 -- 10.20.193.40:0/3814885094 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f21bc005e70 con 0x7f21cc10f060 2026-02-13T01:24:37.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21c1ffb6c0 1 -- 10.20.193.40:0/3814885094 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21bc007d00 con 0x7f21cc10f060 2026-02-13T01:24:37.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.766+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21cc163d80 con 0x7f21cc10f060 2026-02-13T01:24:37.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.767+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21cc110330 con 0x7f21cc10f060 2026-02-13T01:24:37.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.769+0000 7f21c1ffb6c0 1 -- 10.20.193.40:0/3814885094 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f21bc0026b0 con 0x7f21cc10f060 2026-02-13T01:24:37.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.770+0000 7f21c1ffb6c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21a80b5760 0x7f21a80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:37.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.770+0000 7f21c1ffb6c0 1 -- 10.20.193.40:0/3814885094 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8238+0+0 (secure 0 0 0) 0x7f21bc107f30 con 0x7f21cc10f060 2026-02-13T01:24:37.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.771+0000 7f21c3fff6c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21a80b5760 0x7f21a80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:37.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.771+0000 7f21c1ffb6c0 1 -- 10.20.193.40:0/3814885094 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f21bc1083b0 con 0x7f21cc10f060 2026-02-13T01:24:37.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.771+0000 7f21c3fff6c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21a80b5760 0x7f21a80d5c10 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21cc123800 tx=0x7f21b4009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:37.897 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.895+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f21cc10f430 con 0x7f21cc10f060 2026-02-13T01:24:37.897 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.896+0000 7f21c1ffb6c0 1 -- 10.20.193.40:0/3814885094 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f21bc0ca770 con 0x7f21cc10f060 2026-02-13T01:24:37.897 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:37.897 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:37.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21a80b5760 msgr2=0x7f21a80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:37.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21a80b5760 0x7f21a80d5c10 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21cc123800 tx=0x7f21b4009260 comp rx=0 tx=0).stop 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 msgr2=0x7f21cc11ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 0x7f21cc11ce70 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21bc0098c0 tx=0x7f21bc02f820 comp rx=0 tx=0).stop 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 shutdown_connections 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f21a80b5760 0x7f21a80d5c10 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f21cc122770 0x7f21cc122c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f21cc115270 0x7f21cc11d3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 --2- 10.20.193.40:0/3814885094 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f21cc10f060 0x7f21cc11ce70 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 >> 10.20.193.40:0/3814885094 conn(0x7f21cc0ec980 msgr2=0x7f21cc10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 shutdown_connections 2026-02-13T01:24:37.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:37.897+0000 7f21d1d066c0 1 -- 10.20.193.40:0/3814885094 wait complete. 2026-02-13T01:24:37.928 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: pgmap v198: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:24:37.928 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-13T01:24:37.928 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-13T01:24:37.928 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2026-02-13T01:24:37.928 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2026-02-13T01:24:37.929 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2026-02-13T01:24:37.929 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2026-02-13T01:24:37.929 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]': finished 2026-02-13T01:24:37.929 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2026-02-13T01:24:37.929 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2026-02-13T01:24:37.929 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:37 trial040 ceph-mon[23046]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: pgmap v198: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]': finished 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2026-02-13T01:24:38.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2026-02-13T01:24:38.243 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:37 trial055 ceph-mon[27509]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T01:24:38.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: pgmap v198: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:24:38.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-13T01:24:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-13T01:24:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2026-02-13T01:24:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2026-02-13T01:24:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2026-02-13T01:24:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2026-02-13T01:24:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]': finished 2026-02-13T01:24:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2026-02-13T01:24:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2026-02-13T01:24:38.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:37 trial118 ceph-mon[27812]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T01:24:39.142 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:38 trial055 ceph-mon[27509]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T01:24:39.143 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:38 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3814885094' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:39.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:38 trial040 ceph-mon[23046]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T01:24:39.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:38 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3814885094' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:39.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:38 trial118 ceph-mon[27812]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T01:24:39.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:38 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3814885094' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:40.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:39 trial055 ceph-mon[27509]: pgmap v201: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T01:24:40.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:39 trial040 ceph-mon[23046]: pgmap v201: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T01:24:40.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:39 trial118 ceph-mon[27812]: pgmap v201: 97 pgs: 97 active+clean; 649 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T01:24:41.001 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:41.185 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:41.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.384+0000 7fec2f6976c0 1 -- 10.20.193.40:0/3155882804 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec2810fbf0 msgr2=0x7fec28114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:41.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.384+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/3155882804 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec2810fbf0 0x7fec28114c30 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=3316152875839562966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec1c0099a0 tx=0x7fec1c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:41.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.384+0000 7fec2f6976c0 1 -- 10.20.193.40:0/3155882804 shutdown_connections 2026-02-13T01:24:41.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.384+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/3155882804 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fec28115410 0x7fec28175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.384+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/3155882804 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec2810fbf0 0x7fec28114c30 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=3316152875839562966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.384+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/3155882804 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fec2810f200 0x7fec2810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.387 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.384+0000 7fec2f6976c0 1 -- 10.20.193.40:0/3155882804 >> 10.20.193.40:0/3155882804 conn(0x7fec280ecb00 msgr2=0x7fec2810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:41.387 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.385+0000 7fec2f6976c0 1 -- 10.20.193.40:0/3155882804 shutdown_connections 2026-02-13T01:24:41.387 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.385+0000 7fec2f6976c0 1 -- 10.20.193.40:0/3155882804 wait complete. 2026-02-13T01:24:41.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.385+0000 7fec2f6976c0 1 Processor -- start 2026-02-13T01:24:41.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.385+0000 7fec2f6976c0 1 -- start start 2026-02-13T01:24:41.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2f6976c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec2810f200 0x7fec2811cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:41.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2f6976c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fec28115410 0x7fec2811d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2f6976c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fec281228b0 0x7fec28122d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2f6976c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fec281232c0 con 0x7fec2810f200 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2f6976c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fec28123430 con 0x7fec28115410 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2f6976c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fec281235f0 con 0x7fec281228b0 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2cc076c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fec28115410 0x7fec2811d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2d4086c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec2810f200 0x7fec2811cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2cc076c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fec28115410 0x7fec2811d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:59000/0 (socket says 10.20.193.40:59000) 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2cc076c0 1 -- 10.20.193.40:0/2990484729 learned_addr learned my addr 10.20.193.40:0/2990484729 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2dc096c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fec281228b0 0x7fec28122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2d4086c0 1 -- 10.20.193.40:0/2990484729 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fec281228b0 msgr2=0x7fec28122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2d4086c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fec281228b0 0x7fec28122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2d4086c0 1 -- 10.20.193.40:0/2990484729 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fec28115410 msgr2=0x7fec2811d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:41.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2d4086c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fec28115410 0x7fec2811d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2d4086c0 1 -- 10.20.193.40:0/2990484729 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c009590 con 0x7fec2810f200 2026-02-13T01:24:41.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.386+0000 7fec2d4086c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec2810f200 0x7fec2811cfb0 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec1800b6c0 tx=0x7fec1800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:41.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.387+0000 7fec167fc6c0 1 -- 10.20.193.40:0/2990484729 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec18004240 con 0x7fec2810f200 2026-02-13T01:24:41.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.387+0000 7fec167fc6c0 1 -- 10.20.193.40:0/2990484729 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fec18009030 con 0x7fec2810f200 2026-02-13T01:24:41.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.387+0000 7fec167fc6c0 1 -- 10.20.193.40:0/2990484729 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec18003960 con 0x7fec2810f200 2026-02-13T01:24:41.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.387+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec28163aa0 con 0x7fec2810f200 2026-02-13T01:24:41.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.387+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec28163f30 con 0x7fec2810f200 2026-02-13T01:24:41.391 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.387+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec281104d0 con 0x7fec2810f200 2026-02-13T01:24:41.391 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.389+0000 7fec167fc6c0 1 -- 10.20.193.40:0/2990484729 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fec180043a0 con 0x7fec2810f200 2026-02-13T01:24:41.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.391+0000 7fec167fc6c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fec040b5760 0x7fec040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:41.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.391+0000 7fec167fc6c0 1 -- 10.20.193.40:0/2990484729 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fec180e3b90 con 0x7fec2810f200 2026-02-13T01:24:41.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.391+0000 7fec2cc076c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fec040b5760 0x7fec040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:41.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.391+0000 7fec167fc6c0 1 -- 10.20.193.40:0/2990484729 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fec1811c600 con 0x7fec2810f200 2026-02-13T01:24:41.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.392+0000 7fec2cc076c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fec040b5760 0x7fec040d5c10 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec28123940 tx=0x7fec1c005ae0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:41.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.516+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fec2810f5d0 con 0x7fec2810f200 2026-02-13T01:24:41.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.516+0000 7fec167fc6c0 1 -- 10.20.193.40:0/2990484729 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fec180a63d0 con 0x7fec2810f200 2026-02-13T01:24:41.518 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:41.518 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:41.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.517+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fec040b5760 msgr2=0x7fec040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:41.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.517+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fec040b5760 0x7fec040d5c10 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec28123940 tx=0x7fec1c005ae0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec2810f200 msgr2=0x7fec2811cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:41.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec2810f200 0x7fec2811cfb0 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec1800b6c0 tx=0x7fec1800bb90 comp rx=0 tx=0).stop 2026-02-13T01:24:41.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 shutdown_connections 2026-02-13T01:24:41.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fec040b5760 0x7fec040d5c10 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fec281228b0 0x7fec28122d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fec28115410 0x7fec2811d4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 --2- 10.20.193.40:0/2990484729 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec2810f200 0x7fec2811cfb0 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:41.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 >> 10.20.193.40:0/2990484729 conn(0x7fec280ecb00 msgr2=0x7fec2810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:41.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 shutdown_connections 2026-02-13T01:24:41.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:41.518+0000 7fec2f6976c0 1 -- 10.20.193.40:0/2990484729 wait complete. 2026-02-13T01:24:41.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:41 trial040 ceph-mon[23046]: pgmap v202: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T01:24:41.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:41 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2990484729' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:42.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:41 trial055 ceph-mon[27509]: pgmap v202: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T01:24:42.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:41 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2990484729' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:42.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:41 trial118 ceph-mon[27812]: pgmap v202: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T01:24:42.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:41 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2990484729' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:44.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:43 trial055 ceph-mon[27509]: pgmap v203: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:24:44.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:43 trial040 ceph-mon[23046]: pgmap v203: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:24:44.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:43 trial118 ceph-mon[27812]: pgmap v203: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:24:44.656 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:44.840 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:45.032 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.031+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/25439436 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc4cc10fbf0 msgr2=0x7fc4cc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:45.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.031+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/25439436 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc4cc10fbf0 0x7fc4cc114c30 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=14266652210108029224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4c00099a0 tx=0x7fc4c002ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:45.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.031+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/25439436 shutdown_connections 2026-02-13T01:24:45.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.031+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/25439436 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc4cc115410 0x7fc4cc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.031+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/25439436 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc4cc10fbf0 0x7fc4cc114c30 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=14266652210108029224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.031+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/25439436 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc4cc10f200 0x7fc4cc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.031+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/25439436 >> 10.20.193.40:0/25439436 conn(0x7fc4cc0ecb00 msgr2=0x7fc4cc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:45.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.031+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/25439436 shutdown_connections 2026-02-13T01:24:45.033 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.031+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/25439436 wait complete. 2026-02-13T01:24:45.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d332c6c0 1 Processor -- start 2026-02-13T01:24:45.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d332c6c0 1 -- start start 2026-02-13T01:24:45.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d332c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc4cc10f200 0x7fc4cc11cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:45.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d332c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc4cc115410 0x7fc4cc11d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:45.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d332c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc4cc1228b0 0x7fc4cc122d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:45.035 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d332c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc1232c0 con 0x7fc4cc115410 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d332c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc123430 con 0x7fc4cc1228b0 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d332c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc1235f0 con 0x7fc4cc10f200 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d10a16c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc4cc10f200 0x7fc4cc11cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d10a16c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc4cc10f200 0x7fc4cc11cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:60992/0 (socket says 10.20.193.40:60992) 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d08a06c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc4cc115410 0x7fc4cc11d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d10a16c0 1 -- 10.20.193.40:0/3702324706 learned_addr learned my addr 10.20.193.40:0/3702324706 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d18a26c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc4cc1228b0 0x7fc4cc122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d08a06c0 1 -- 10.20.193.40:0/3702324706 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc4cc10f200 msgr2=0x7fc4cc11cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d08a06c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc4cc10f200 0x7fc4cc11cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d08a06c0 1 -- 10.20.193.40:0/3702324706 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc4cc1228b0 msgr2=0x7fc4cc122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:45.036 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d08a06c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc4cc1228b0 0x7fc4cc122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.037 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.032+0000 7fc4d08a06c0 1 -- 10.20.193.40:0/3702324706 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c0009590 con 0x7fc4cc115410 2026-02-13T01:24:45.037 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.033+0000 7fc4d08a06c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc4cc115410 0x7fc4cc11d4f0 secure :-1 s=READY pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4c002f210 tx=0x7fc4c002f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:45.037 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.033+0000 7fc4ba7fc6c0 1 -- 10.20.193.40:0/3702324706 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4c00046b0 con 0x7fc4cc115410 2026-02-13T01:24:45.037 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.033+0000 7fc4ba7fc6c0 1 -- 10.20.193.40:0/3702324706 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc4c0005e50 con 0x7fc4cc115410 2026-02-13T01:24:45.037 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.033+0000 7fc4ba7fc6c0 1 -- 10.20.193.40:0/3702324706 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4c00073f0 con 0x7fc4cc115410 2026-02-13T01:24:45.037 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.033+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4cc163a40 con 0x7fc4cc115410 2026-02-13T01:24:45.037 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.033+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4cc163e70 con 0x7fc4cc115410 2026-02-13T01:24:45.037 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.033+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4cc1104d0 con 0x7fc4cc115410 2026-02-13T01:24:45.038 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.036+0000 7fc4ba7fc6c0 1 -- 10.20.193.40:0/3702324706 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc4c00026b0 con 0x7fc4cc115410 2026-02-13T01:24:45.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.038+0000 7fc4ba7fc6c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc4a80b5760 0x7fc4a80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:45.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.038+0000 7fc4ba7fc6c0 1 -- 10.20.193.40:0/3702324706 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fc4c0107e30 con 0x7fc4cc115410 2026-02-13T01:24:45.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.038+0000 7fc4d10a16c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc4a80b5760 0x7fc4a80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:45.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.038+0000 7fc4ba7fc6c0 1 -- 10.20.193.40:0/3702324706 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc4c01082b0 con 0x7fc4cc115410 2026-02-13T01:24:45.040 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.039+0000 7fc4d10a16c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc4a80b5760 0x7fc4a80d5c10 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4bc0095c0 tx=0x7fc4bc009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:45.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.162+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc4cc10f5d0 con 0x7fc4cc115410 2026-02-13T01:24:45.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.162+0000 7fc4ba7fc6c0 1 -- 10.20.193.40:0/3702324706 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc4c00ca670 con 0x7fc4cc115410 2026-02-13T01:24:45.164 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:45.164 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:45.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc4a80b5760 msgr2=0x7fc4a80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:45.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc4a80b5760 0x7fc4a80d5c10 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4bc0095c0 tx=0x7fc4bc009260 comp rx=0 tx=0).stop 2026-02-13T01:24:45.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc4cc115410 msgr2=0x7fc4cc11d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:45.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc4cc115410 0x7fc4cc11d4f0 secure :-1 s=READY pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4c002f210 tx=0x7fc4c002f810 comp rx=0 tx=0).stop 2026-02-13T01:24:45.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 shutdown_connections 2026-02-13T01:24:45.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc4a80b5760 0x7fc4a80d5c10 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc4cc1228b0 0x7fc4cc122d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc4cc115410 0x7fc4cc11d4f0 unknown :-1 s=CLOSED pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 --2- 10.20.193.40:0/3702324706 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc4cc10f200 0x7fc4cc11cfb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 >> 10.20.193.40:0/3702324706 conn(0x7fc4cc0ecb00 msgr2=0x7fc4cc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:45.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 shutdown_connections 2026-02-13T01:24:45.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:45.163+0000 7fc4d332c6c0 1 -- 10.20.193.40:0/3702324706 wait complete. 2026-02-13T01:24:46.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:45 trial055 ceph-mon[27509]: pgmap v204: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:24:46.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:45 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3702324706' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:46.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:45 trial040 ceph-mon[23046]: pgmap v204: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:24:46.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:45 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3702324706' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:46.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:45 trial118 ceph-mon[27812]: pgmap v204: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:24:46.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:45 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3702324706' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:48.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:47 trial055 ceph-mon[27509]: pgmap v205: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 6 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:24:48.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:47 trial040 ceph-mon[23046]: pgmap v205: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 6 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:24:48.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:47 trial118 ceph-mon[27812]: pgmap v205: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 6 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:24:48.303 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:48.486 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:48.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.679+0000 7fe2188096c0 1 -- 10.20.193.40:0/2324517524 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010fbf0 msgr2=0x7fe210114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:48.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.679+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2324517524 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010fbf0 0x7fe210114c30 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=17429357324426979916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1fc0099a0 tx=0x7fe1fc02ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:48.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.679+0000 7fe2188096c0 1 -- 10.20.193.40:0/2324517524 shutdown_connections 2026-02-13T01:24:48.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.679+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2324517524 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe210115410 0x7fe210175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:48.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.679+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2324517524 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010fbf0 0x7fe210114c30 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=17429357324426979916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:48.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.679+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2324517524 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe21010f200 0x7fe21010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:48.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.679+0000 7fe2188096c0 1 -- 10.20.193.40:0/2324517524 >> 10.20.193.40:0/2324517524 conn(0x7fe2100ecb00 msgr2=0x7fe21010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:48.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.679+0000 7fe2188096c0 1 -- 10.20.193.40:0/2324517524 shutdown_connections 2026-02-13T01:24:48.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.679+0000 7fe2188096c0 1 -- 10.20.193.40:0/2324517524 wait complete. 2026-02-13T01:24:48.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.680+0000 7fe2188096c0 1 Processor -- start 2026-02-13T01:24:48.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.680+0000 7fe2188096c0 1 -- start start 2026-02-13T01:24:48.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.680+0000 7fe2188096c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010f200 0x7fe2100f4900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:48.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.680+0000 7fe2188096c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe210115410 0x7fe210175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:48.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.680+0000 7fe2188096c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe2100f4f30 0x7fe2100fa200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.680+0000 7fe2188096c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe2100f5590 con 0x7fe21010f200 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.680+0000 7fe2188096c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe2100fa740 con 0x7fe2100f4f30 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.680+0000 7fe2188096c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe2100fa900 con 0x7fe210115410 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe21657a6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010f200 0x7fe2100f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe21657a6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010f200 0x7fe2100f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48122/0 (socket says 10.20.193.40:48122) 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe21657a6c0 1 -- 10.20.193.40:0/2440376696 learned_addr learned my addr 10.20.193.40:0/2440376696 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe215d796c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe210115410 0x7fe210175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe216d7b6c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe2100f4f30 0x7fe2100fa200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe21657a6c0 1 -- 10.20.193.40:0/2440376696 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe210115410 msgr2=0x7fe210175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe21657a6c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe210115410 0x7fe210175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:48.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe21657a6c0 1 -- 10.20.193.40:0/2440376696 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe2100f4f30 msgr2=0x7fe2100fa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:48.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe21657a6c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe2100f4f30 0x7fe2100fa200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:48.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe21657a6c0 1 -- 10.20.193.40:0/2440376696 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc009590 con 0x7fe21010f200 2026-02-13T01:24:48.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe21657a6c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010f200 0x7fe2100f4900 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe20800b6c0 tx=0x7fe20800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:48.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe1fb7fe6c0 1 -- 10.20.193.40:0/2440376696 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe208004560 con 0x7fe21010f200 2026-02-13T01:24:48.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe1fb7fe6c0 1 -- 10.20.193.40:0/2440376696 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe208009030 con 0x7fe21010f200 2026-02-13T01:24:48.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe1fb7fe6c0 1 -- 10.20.193.40:0/2440376696 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2080071c0 con 0x7fe21010f200 2026-02-13T01:24:48.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2100fab80 con 0x7fe21010f200 2026-02-13T01:24:48.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.681+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2100fb010 con 0x7fe21010f200 2026-02-13T01:24:48.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.682+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2101104d0 con 0x7fe21010f200 2026-02-13T01:24:48.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.684+0000 7fe1fb7fe6c0 1 -- 10.20.193.40:0/2440376696 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fe20800c530 con 0x7fe21010f200 2026-02-13T01:24:48.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.686+0000 7fe1fb7fe6c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe1ec0b5760 0x7fe1ec0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:48.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.686+0000 7fe1fb7fe6c0 1 -- 10.20.193.40:0/2440376696 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fe2080e3bf0 con 0x7fe21010f200 2026-02-13T01:24:48.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.686+0000 7fe1fb7fe6c0 1 -- 10.20.193.40:0/2440376696 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe20811c660 con 0x7fe21010f200 2026-02-13T01:24:48.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.686+0000 7fe215d796c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe1ec0b5760 0x7fe1ec0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:48.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.687+0000 7fe215d796c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe1ec0b5760 0x7fe1ec0d5c10 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1fc0023e0 tx=0x7fe1fc005c80 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:48.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.812+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe21010f5d0 con 0x7fe21010f200 2026-02-13T01:24:48.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.812+0000 7fe1fb7fe6c0 1 -- 10.20.193.40:0/2440376696 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe2080a6430 con 0x7fe21010f200 2026-02-13T01:24:48.813 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:48.814 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe1ec0b5760 msgr2=0x7fe1ec0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe1ec0b5760 0x7fe1ec0d5c10 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1fc0023e0 tx=0x7fe1fc005c80 comp rx=0 tx=0).stop 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010f200 msgr2=0x7fe2100f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010f200 0x7fe2100f4900 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe20800b6c0 tx=0x7fe20800bb90 comp rx=0 tx=0).stop 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 shutdown_connections 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe1ec0b5760 0x7fe1ec0d5c10 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe2100f4f30 0x7fe2100fa200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe210115410 0x7fe210175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 --2- 10.20.193.40:0/2440376696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe21010f200 0x7fe2100f4900 unknown :-1 s=CLOSED pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 >> 10.20.193.40:0/2440376696 conn(0x7fe2100ecb00 msgr2=0x7fe21010d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:48.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 shutdown_connections 2026-02-13T01:24:48.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:48.813+0000 7fe2188096c0 1 -- 10.20.193.40:0/2440376696 wait complete. 2026-02-13T01:24:50.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:49 trial055 ceph-mon[27509]: pgmap v206: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 7 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:24:50.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:49 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2440376696' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:50.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:49 trial040 ceph-mon[23046]: pgmap v206: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 7 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:24:50.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:49 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2440376696' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:50.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:49 trial118 ceph-mon[27812]: pgmap v206: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 7 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:24:50.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:49 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2440376696' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:51.115 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:50 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:51.120 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:50 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:50 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:51.918 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:52.106 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:52.148 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:51 trial040 ceph-mon[23046]: pgmap v207: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:24:52.148 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:51 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.148 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:51 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.148 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:51 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.149 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:51 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:51 trial055 ceph-mon[27509]: pgmap v207: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:24:52.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:51 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:51 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:51 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:51 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:51 trial118 ceph-mon[27812]: pgmap v207: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:24:52.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:51 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:51 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:51 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:51 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:52.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.304+0000 7f6703fff6c0 1 -- 10.20.193.40:0/3614041689 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704115270 msgr2=0x7f6704175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:52.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.304+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/3614041689 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704115270 0x7f6704175c10 secure :-1 s=READY pgs=261 gs=2 cs=0 l=1 c_cookie=15636772722836669705 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66f400aa70 tx=0x7f66f402fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.304+0000 7f6703fff6c0 1 -- 10.20.193.40:0/3614041689 shutdown_connections 2026-02-13T01:24:52.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.304+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/3614041689 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704115270 0x7f6704175c10 unknown :-1 s=CLOSED pgs=261 gs=2 cs=0 l=1 c_cookie=15636772722836669705 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.304+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/3614041689 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f670410fa50 0x7f6704114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.304+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/3614041689 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f670410f060 0x7f670410f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.304+0000 7f6703fff6c0 1 -- 10.20.193.40:0/3614041689 >> 10.20.193.40:0/3614041689 conn(0x7f67040ec980 msgr2=0x7f670410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:52.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.305+0000 7f6703fff6c0 1 -- 10.20.193.40:0/3614041689 shutdown_connections 2026-02-13T01:24:52.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.305+0000 7f6703fff6c0 1 -- 10.20.193.40:0/3614041689 wait complete. 2026-02-13T01:24:52.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f6703fff6c0 1 Processor -- start 2026-02-13T01:24:52.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f6703fff6c0 1 -- start start 2026-02-13T01:24:52.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f6703fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f670410f060 0x7f670411cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:52.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f6703fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6704115270 0x7f670411d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:52.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f6703fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704122680 0x7f6704122b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:52.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f6703fff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6704123090 con 0x7f6704122680 2026-02-13T01:24:52.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f6703fff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6704123200 con 0x7f6704115270 2026-02-13T01:24:52.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f6703fff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f67041233c0 con 0x7f670410f060 2026-02-13T01:24:52.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f67037fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704122680 0x7f6704122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:52.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f67037fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704122680 0x7f6704122b20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:39348/0 (socket says 10.20.193.40:39348) 2026-02-13T01:24:52.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.306+0000 7f67037fe6c0 1 -- 10.20.193.40:0/1666153549 learned_addr learned my addr 10.20.193.40:0/1666153549 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f6702ffd6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f670410f060 0x7f670411cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f67027fc6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6704115270 0x7f670411d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f67037fe6c0 1 -- 10.20.193.40:0/1666153549 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f670410f060 msgr2=0x7f670411cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f67037fe6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f670410f060 0x7f670411cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f67037fe6c0 1 -- 10.20.193.40:0/1666153549 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6704115270 msgr2=0x7f670411d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f67037fe6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6704115270 0x7f670411d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f67037fe6c0 1 -- 10.20.193.40:0/1666153549 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f400a660 con 0x7f6704122680 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f67027fc6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6704115270 0x7f670411d2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f67037fe6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704122680 0x7f6704122b20 secure :-1 s=READY pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66f400ab70 tx=0x7f66f4032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f66e3fff6c0 1 -- 10.20.193.40:0/1666153549 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66f40054a0 con 0x7f6704122680 2026-02-13T01:24:52.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f66e3fff6c0 1 -- 10.20.193.40:0/1666153549 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f66f4003d40 con 0x7f6704122680 2026-02-13T01:24:52.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f66e3fff6c0 1 -- 10.20.193.40:0/1666153549 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66f4032030 con 0x7f6704122680 2026-02-13T01:24:52.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6704163810 con 0x7f6704122680 2026-02-13T01:24:52.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.307+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6704163c40 con 0x7f6704122680 2026-02-13T01:24:52.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.308+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6704110330 con 0x7f6704122680 2026-02-13T01:24:52.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.312+0000 7f66e3fff6c0 1 -- 10.20.193.40:0/1666153549 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f66f4005600 con 0x7f6704122680 2026-02-13T01:24:52.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.313+0000 7f66e3fff6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66d80b5760 0x7f66d80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:52.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.313+0000 7f66e3fff6c0 1 -- 10.20.193.40:0/1666153549 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f66f4108fd0 con 0x7f6704122680 2026-02-13T01:24:52.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.313+0000 7f6702ffd6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66d80b5760 0x7f66d80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:52.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.314+0000 7f66e3fff6c0 1 -- 10.20.193.40:0/1666153549 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f66f4109450 con 0x7f6704122680 2026-02-13T01:24:52.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.314+0000 7f6702ffd6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66d80b5760 0x7f66d80d5c10 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66f8004750 tx=0x7f66f8009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:52.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.439+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f670411ded0 con 0x7f6704122680 2026-02-13T01:24:52.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.439+0000 7f66e3fff6c0 1 -- 10.20.193.40:0/1666153549 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f66f40cb810 con 0x7f6704122680 2026-02-13T01:24:52.441 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:52.441 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:52.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.441+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66d80b5760 msgr2=0x7f66d80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:52.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.441+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66d80b5760 0x7f66d80d5c10 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66f8004750 tx=0x7f66f8009260 comp rx=0 tx=0).stop 2026-02-13T01:24:52.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.441+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704122680 msgr2=0x7f6704122b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:52.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.441+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704122680 0x7f6704122b20 secure :-1 s=READY pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66f400ab70 tx=0x7f66f4032f60 comp rx=0 tx=0).stop 2026-02-13T01:24:52.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.442+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 shutdown_connections 2026-02-13T01:24:52.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.442+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f66d80b5760 0x7f66d80d5c10 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.442+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6704122680 0x7f6704122b20 unknown :-1 s=CLOSED pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.442+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f6704115270 0x7f670411d2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.442+0000 7f6703fff6c0 1 --2- 10.20.193.40:0/1666153549 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f670410f060 0x7f670411cd80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.442+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 >> 10.20.193.40:0/1666153549 conn(0x7f67040ec980 msgr2=0x7f670410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:52.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.442+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 shutdown_connections 2026-02-13T01:24:52.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:52.442+0000 7f6703fff6c0 1 -- 10.20.193.40:0/1666153549 wait complete. 2026-02-13T01:24:53.315 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:53.315 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:53.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1666153549' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:53.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: pgmap v208: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:24:53.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:53.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:53.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: pgmap v209: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:24:53.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:53.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:53.316 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1666153549' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: pgmap v208: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: pgmap v209: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:53.492 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:53.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:53.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1666153549' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:53.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: pgmap v208: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:24:53.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:53.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:24:53.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: pgmap v209: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:24:53.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:53.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:53.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:54.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:54 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:54.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:54 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:24:54.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:54 trial055 ceph-mon[27509]: pgmap v210: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:24:54.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:54 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:54.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:54 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:24:54.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:54 trial040 ceph-mon[23046]: pgmap v210: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:24:54.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:54 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:54.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:54 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:24:54.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:54 trial118 ceph-mon[27812]: pgmap v210: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:24:55.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:55 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:55.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:55 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:55.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:55 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:55.548 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:55.734 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.931+0000 7f61d30da6c0 1 -- 10.20.193.40:0/245060166 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc10f060 msgr2=0x7f61cc10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.931+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/245060166 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc10f060 0x7f61cc10f430 secure :-1 s=READY pgs=263 gs=2 cs=0 l=1 c_cookie=6772115390662049423 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61bc0099a0 tx=0x7f61bc02ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.932+0000 7f61d30da6c0 1 -- 10.20.193.40:0/245060166 shutdown_connections 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.932+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/245060166 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f61cc115270 0x7f61cc175c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.932+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/245060166 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61cc10fa50 0x7f61cc114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.932+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/245060166 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc10f060 0x7f61cc10f430 unknown :-1 s=CLOSED pgs=263 gs=2 cs=0 l=1 c_cookie=6772115390662049423 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.932+0000 7f61d30da6c0 1 -- 10.20.193.40:0/245060166 >> 10.20.193.40:0/245060166 conn(0x7f61cc0ec980 msgr2=0x7f61cc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.932+0000 7f61d30da6c0 1 -- 10.20.193.40:0/245060166 shutdown_connections 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.932+0000 7f61d30da6c0 1 -- 10.20.193.40:0/245060166 wait complete. 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.932+0000 7f61d30da6c0 1 Processor -- start 2026-02-13T01:24:55.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d30da6c0 1 -- start start 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d30da6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61cc10f060 0x7f61cc05dc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d30da6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc115270 0x7f61cc175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d30da6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f61cc05e280 0x7f61cc102a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d30da6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc05e970 con 0x7f61cc115270 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d30da6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc102fc0 con 0x7f61cc05e280 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d30da6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc103180 con 0x7f61cc10f060 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d18d76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc115270 0x7f61cc175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d28d96c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f61cc05e280 0x7f61cc102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d20d86c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61cc10f060 0x7f61cc05dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d18d76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc115270 0x7f61cc175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:39366/0 (socket says 10.20.193.40:39366) 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d18d76c0 1 -- 10.20.193.40:0/234341620 learned_addr learned my addr 10.20.193.40:0/234341620 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d18d76c0 1 -- 10.20.193.40:0/234341620 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61cc10f060 msgr2=0x7f61cc05dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d18d76c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61cc10f060 0x7f61cc05dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d18d76c0 1 -- 10.20.193.40:0/234341620 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f61cc05e280 msgr2=0x7f61cc102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d18d76c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f61cc05e280 0x7f61cc102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.933+0000 7f61d18d76c0 1 -- 10.20.193.40:0/234341620 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc009590 con 0x7f61cc115270 2026-02-13T01:24:55.934 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.934+0000 7f61d18d76c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc115270 0x7f61cc175b10 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61c000b750 tx=0x7f61c000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:55.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.934+0000 7f61b37fe6c0 1 -- 10.20.193.40:0/234341620 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61c0004a80 con 0x7f61cc115270 2026-02-13T01:24:55.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.934+0000 7f61b37fe6c0 1 -- 10.20.193.40:0/234341620 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f61c0009030 con 0x7f61cc115270 2026-02-13T01:24:55.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.934+0000 7f61b37fe6c0 1 -- 10.20.193.40:0/234341620 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61c00071c0 con 0x7f61cc115270 2026-02-13T01:24:55.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.934+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61cc103460 con 0x7f61cc115270 2026-02-13T01:24:55.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.934+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61cc1038f0 con 0x7f61cc115270 2026-02-13T01:24:55.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.934+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61cc110330 con 0x7f61cc115270 2026-02-13T01:24:55.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.937+0000 7f61b37fe6c0 1 -- 10.20.193.40:0/234341620 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f61c0004e90 con 0x7f61cc115270 2026-02-13T01:24:55.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.938+0000 7f61b37fe6c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61a80b5760 0x7f61a80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:55.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.938+0000 7f61b37fe6c0 1 -- 10.20.193.40:0/234341620 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f61c00e39a0 con 0x7f61cc115270 2026-02-13T01:24:55.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.938+0000 7f61d20d86c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61a80b5760 0x7f61a80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:55.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.938+0000 7f61b37fe6c0 1 -- 10.20.193.40:0/234341620 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f61c00e3e20 con 0x7f61cc115270 2026-02-13T01:24:55.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:55.939+0000 7f61d20d86c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61a80b5760 0x7f61a80d5c10 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61bc005b40 tx=0x7f61bc0023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:56.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.064+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f61cc10f430 con 0x7f61cc115270 2026-02-13T01:24:56.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.064+0000 7f61b37fe6c0 1 -- 10.20.193.40:0/234341620 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f61c00a61e0 con 0x7f61cc115270 2026-02-13T01:24:56.065 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:56.065 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:56.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61a80b5760 msgr2=0x7f61a80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61a80b5760 0x7f61a80d5c10 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61bc005b40 tx=0x7f61bc0023a0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc115270 msgr2=0x7f61cc175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc115270 0x7f61cc175b10 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61c000b750 tx=0x7f61c000bc20 comp rx=0 tx=0).stop 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 shutdown_connections 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f61a80b5760 0x7f61a80d5c10 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f61cc05e280 0x7f61cc102a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f61cc115270 0x7f61cc175b10 unknown :-1 s=CLOSED pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 --2- 10.20.193.40:0/234341620 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f61cc10f060 0x7f61cc05dc50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 >> 10.20.193.40:0/234341620 conn(0x7f61cc0ec980 msgr2=0x7f61cc10d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 shutdown_connections 2026-02-13T01:24:56.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:56.066+0000 7f61d30da6c0 1 -- 10.20.193.40:0/234341620 wait complete. 2026-02-13T01:24:56.129 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:56 trial040 ceph-mon[23046]: pgmap v211: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:24:56.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:56 trial055 ceph-mon[27509]: pgmap v211: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:24:56.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:56 trial118 ceph-mon[27812]: pgmap v211: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:24:57.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:57 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/234341620' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:57.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:57 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/234341620' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:57.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:57 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/234341620' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:24:58.491 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:24:58 trial055 ceph-mon[27509]: pgmap v212: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 4 op/s 2026-02-13T01:24:58.498 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:24:58 trial040 ceph-mon[23046]: pgmap v212: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 4 op/s 2026-02-13T01:24:58.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:24:58 trial118 ceph-mon[27812]: pgmap v212: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 4 op/s 2026-02-13T01:24:59.175 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:24:59.362 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.561+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3607855135 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c010f060 msgr2=0x7ff5c010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.561+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3607855135 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c010f060 0x7ff5c010f430 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=12696483942683481170 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5b00099a0 tx=0x7ff5b002ed00 comp rx=0 tx=0).stop 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.561+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3607855135 shutdown_connections 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.561+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3607855135 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff5c0115270 0x7ff5c0175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.561+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3607855135 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff5c010fa50 0x7ff5c0114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.561+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3607855135 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c010f060 0x7ff5c010f430 unknown :-1 s=CLOSED pgs=265 gs=1 cs=0 l=1 c_cookie=12696483942683481170 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.561+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3607855135 >> 10.20.193.40:0/3607855135 conn(0x7ff5c00ec980 msgr2=0x7ff5c010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.561+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3607855135 shutdown_connections 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.561+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3607855135 wait complete. 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c65c36c0 1 Processor -- start 2026-02-13T01:24:59.562 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c65c36c0 1 -- start start 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c65c36c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff5c010f060 0x7ff5c011ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c65c36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c0115270 0x7ff5c011d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c65c36c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff5c0122700 0x7ff5c0122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c65c36c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0123110 con 0x7ff5c0115270 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c65c36c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0123280 con 0x7ff5c010f060 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c65c36c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0123440 con 0x7ff5c0122700 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c4dc06c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c0115270 0x7ff5c011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c5dc26c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff5c0122700 0x7ff5c0122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c55c16c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff5c010f060 0x7ff5c011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c4dc06c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c0115270 0x7ff5c011d340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:39388/0 (socket says 10.20.193.40:39388) 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c4dc06c0 1 -- 10.20.193.40:0/3537799434 learned_addr learned my addr 10.20.193.40:0/3537799434 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c4dc06c0 1 -- 10.20.193.40:0/3537799434 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff5c0122700 msgr2=0x7ff5c0122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c4dc06c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff5c0122700 0x7ff5c0122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c4dc06c0 1 -- 10.20.193.40:0/3537799434 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff5c010f060 msgr2=0x7ff5c011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c4dc06c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff5c010f060 0x7ff5c011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c4dc06c0 1 -- 10.20.193.40:0/3537799434 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b0009590 con 0x7ff5c0115270 2026-02-13T01:24:59.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.562+0000 7ff5c55c16c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff5c010f060 0x7ff5c011ce00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:59.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.563+0000 7ff5c4dc06c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c0115270 0x7ff5c011d340 secure :-1 s=READY pgs=266 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5b400b750 tx=0x7ff5b400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:59.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.563+0000 7ff5ae7fc6c0 1 -- 10.20.193.40:0/3537799434 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5b4004a80 con 0x7ff5c0115270 2026-02-13T01:24:59.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.563+0000 7ff5ae7fc6c0 1 -- 10.20.193.40:0/3537799434 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff5b4009030 con 0x7ff5c0115270 2026-02-13T01:24:59.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.563+0000 7ff5ae7fc6c0 1 -- 10.20.193.40:0/3537799434 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5b400cea0 con 0x7ff5c0115270 2026-02-13T01:24:59.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.563+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c01638f0 con 0x7ff5c0115270 2026-02-13T01:24:59.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.563+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c0163d80 con 0x7ff5c0115270 2026-02-13T01:24:59.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.563+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c0110330 con 0x7ff5c0115270 2026-02-13T01:24:59.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.566+0000 7ff5ae7fc6c0 1 -- 10.20.193.40:0/3537799434 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff5b4005020 con 0x7ff5c0115270 2026-02-13T01:24:59.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.567+0000 7ff5ae7fc6c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff59c0b5760 0x7ff59c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:59.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.568+0000 7ff5ae7fc6c0 1 -- 10.20.193.40:0/3537799434 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7ff5b40e3d50 con 0x7ff5c0115270 2026-02-13T01:24:59.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.568+0000 7ff5c55c16c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff59c0b5760 0x7ff59c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:59.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.568+0000 7ff5ae7fc6c0 1 -- 10.20.193.40:0/3537799434 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff5b40e41d0 con 0x7ff5c0115270 2026-02-13T01:24:59.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.568+0000 7ff5c55c16c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff59c0b5760 0x7ff59c0d5c10 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5b00023e0 tx=0x7ff5b00071c0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:59.693 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.692+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff5c010f430 con 0x7ff5c0115270 2026-02-13T01:24:59.693 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.693+0000 7ff5ae7fc6c0 1 -- 10.20.193.40:0/3537799434 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff5b40a6590 con 0x7ff5c0115270 2026-02-13T01:24:59.693 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:24:59.694 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:24:59.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff59c0b5760 msgr2=0x7ff59c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:59.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff59c0b5760 0x7ff59c0d5c10 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5b00023e0 tx=0x7ff5b00071c0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c0115270 msgr2=0x7ff5c011d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c0115270 0x7ff5c011d340 secure :-1 s=READY pgs=266 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5b400b750 tx=0x7ff5b400bc20 comp rx=0 tx=0).stop 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 shutdown_connections 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff59c0b5760 0x7ff59c0d5c10 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff5c0122700 0x7ff5c0122ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff5c0115270 0x7ff5c011d340 unknown :-1 s=CLOSED pgs=266 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 --2- 10.20.193.40:0/3537799434 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff5c010f060 0x7ff5c011ce00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 >> 10.20.193.40:0/3537799434 conn(0x7ff5c00ec980 msgr2=0x7ff5c010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 shutdown_connections 2026-02-13T01:24:59.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:24:59.694+0000 7ff5c65c36c0 1 -- 10.20.193.40:0/3537799434 wait complete. 2026-02-13T01:25:00.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:00 trial118 ceph-mon[27812]: pgmap v213: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:25:00.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:00 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3537799434' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:00.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:00 trial055 ceph-mon[27509]: pgmap v213: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:25:00.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:00 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3537799434' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:00.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:00 trial040 ceph-mon[23046]: pgmap v213: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:25:00.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:00 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3537799434' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:02.800 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:02.851 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:02 trial040 ceph-mon[23046]: pgmap v214: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:25:02.984 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:02.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:02 trial055 ceph-mon[27509]: pgmap v214: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:25:03.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:02 trial118 ceph-mon[27812]: pgmap v214: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3811150330 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ca010cde0 msgr2=0x7f5ca010d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3811150330 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ca010cde0 0x7f5ca010d1b0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=13823895734477063878 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c900099a0 tx=0x7f5c9002ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3811150330 shutdown_connections 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3811150330 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ca0112ff0 0x7f5ca0173990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3811150330 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ca010d7d0 0x7f5ca0112810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3811150330 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ca010cde0 0x7f5ca010d1b0 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=13823895734477063878 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3811150330 >> 10.20.193.40:0/3811150330 conn(0x7f5ca00ea6a0 msgr2=0x7f5ca010aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3811150330 shutdown_connections 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3811150330 wait complete. 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 Processor -- start 2026-02-13T01:25:03.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.172+0000 7f5ca66546c0 1 -- start start 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca66546c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ca010cde0 0x7f5ca011ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca66546c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ca0112ff0 0x7f5ca011b0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca66546c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ca0120470 0x7f5ca0120910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca66546c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0120e80 con 0x7f5ca0120470 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca66546c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0120ff0 con 0x7f5ca0112ff0 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca66546c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01211b0 con 0x7f5ca010cde0 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca4e516c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ca0112ff0 0x7f5ca011b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca4e516c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ca0112ff0 0x7f5ca011b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:35370/0 (socket says 10.20.193.40:35370) 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca4e516c0 1 -- 10.20.193.40:0/3268784862 learned_addr learned my addr 10.20.193.40:0/3268784862 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca56526c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ca010cde0 0x7f5ca011ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca5e536c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ca0120470 0x7f5ca0120910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca4e516c0 1 -- 10.20.193.40:0/3268784862 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ca010cde0 msgr2=0x7f5ca011ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca4e516c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ca010cde0 0x7f5ca011ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca4e516c0 1 -- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ca0120470 msgr2=0x7f5ca0120910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca4e516c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ca0120470 0x7f5ca0120910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca4e516c0 1 -- 10.20.193.40:0/3268784862 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c90009590 con 0x7f5ca0112ff0 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca56526c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ca010cde0 0x7f5ca011ab70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.173+0000 7f5ca4e516c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ca0112ff0 0x7f5ca011b0b0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c9400b750 tx=0x7f5c9400bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:03.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.174+0000 7f5c8e7fc6c0 1 -- 10.20.193.40:0/3268784862 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c94004a80 con 0x7f5ca0112ff0 2026-02-13T01:25:03.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.174+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca0060640 con 0x7f5ca0112ff0 2026-02-13T01:25:03.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.174+0000 7f5c8e7fc6c0 1 -- 10.20.193.40:0/3268784862 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5c94009030 con 0x7f5ca0112ff0 2026-02-13T01:25:03.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.174+0000 7f5c8e7fc6c0 1 -- 10.20.193.40:0/3268784862 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c9400cea0 con 0x7f5ca0112ff0 2026-02-13T01:25:03.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.174+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca0060ad0 con 0x7f5ca0112ff0 2026-02-13T01:25:03.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.174+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca010e0b0 con 0x7f5ca0112ff0 2026-02-13T01:25:03.177 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.176+0000 7f5c8e7fc6c0 1 -- 10.20.193.40:0/3268784862 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f5c94005020 con 0x7f5ca0112ff0 2026-02-13T01:25:03.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.178+0000 7f5c8e7fc6c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5c7c0b5760 0x7f5c7c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:03.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.178+0000 7f5c8e7fc6c0 1 -- 10.20.193.40:0/3268784862 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f5c940e3d00 con 0x7f5ca0112ff0 2026-02-13T01:25:03.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.178+0000 7f5ca56526c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5c7c0b5760 0x7f5c7c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:03.179 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.178+0000 7f5c8e7fc6c0 1 -- 10.20.193.40:0/3268784862 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5c940e4180 con 0x7f5ca0112ff0 2026-02-13T01:25:03.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.179+0000 7f5ca56526c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5c7c0b5760 0x7f5c7c0d5c10 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c900023e0 tx=0x7f5c900071c0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:03.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.303+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5ca010d1b0 con 0x7f5ca0112ff0 2026-02-13T01:25:03.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.303+0000 7f5c8e7fc6c0 1 -- 10.20.193.40:0/3268784862 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f5c940a6540 con 0x7f5ca0112ff0 2026-02-13T01:25:03.304 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:03.304 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5c7c0b5760 msgr2=0x7f5c7c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5c7c0b5760 0x7f5c7c0d5c10 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c900023e0 tx=0x7f5c900071c0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ca0112ff0 msgr2=0x7f5ca011b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ca0112ff0 0x7f5ca011b0b0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c9400b750 tx=0x7f5c9400bc20 comp rx=0 tx=0).stop 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 shutdown_connections 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f5c7c0b5760 0x7f5c7c0d5c10 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5ca0120470 0x7f5ca0120910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5ca0112ff0 0x7f5ca011b0b0 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 --2- 10.20.193.40:0/3268784862 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5ca010cde0 0x7f5ca011ab70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 >> 10.20.193.40:0/3268784862 conn(0x7f5ca00ea6a0 msgr2=0x7f5ca010aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 shutdown_connections 2026-02-13T01:25:03.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:03.304+0000 7f5ca66546c0 1 -- 10.20.193.40:0/3268784862 wait complete. 2026-02-13T01:25:03.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:03 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3268784862' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:03.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:03 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3268784862' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:04.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:03 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3268784862' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:04.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:04 trial055 ceph-mon[27509]: pgmap v215: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 7 op/s 2026-02-13T01:25:04.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:04 trial040 ceph-mon[23046]: pgmap v215: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 7 op/s 2026-02-13T01:25:05.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:04 trial118 ceph-mon[27812]: pgmap v215: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 7 op/s 2026-02-13T01:25:06.409 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:06.596 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:06.727 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:06 trial040 ceph-mon[23046]: pgmap v216: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.791+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/782610450 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410c480 msgr2=0x7f4554110a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.791+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/782610450 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410c480 0x7f4554110a50 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=16594977802074426364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4548009970 tx=0x7f454802ed10 comp rx=0 tx=0).stop 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.791+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/782610450 shutdown_connections 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.791+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/782610450 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f45541110a0 0x7f4554111520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.791+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/782610450 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410c480 0x7f4554110a50 unknown :-1 s=CLOSED pgs=268 gs=1 cs=0 l=1 c_cookie=16594977802074426364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.791+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/782610450 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f455410ba90 0x7f455410be60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.791+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/782610450 >> 10.20.193.40:0/782610450 conn(0x7f45540e9700 msgr2=0x7f4554109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.791+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/782610450 shutdown_connections 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.791+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/782610450 wait complete. 2026-02-13T01:25:06.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f455bb3c6c0 1 Processor -- start 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f455bb3c6c0 1 -- start start 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f455bb3c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410ba90 0x7f4554121920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f455bb3c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f455410c480 0x7f4554121e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f455bb3c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f45541110a0 0x7f4554127220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f455bb3c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4554127870 con 0x7f455410ba90 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f455bb3c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f45541279e0 con 0x7f455410c480 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f455bb3c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4554127ba0 con 0x7f45541110a0 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f45598b16c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410ba90 0x7f4554121920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f45598b16c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410ba90 0x7f4554121920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55766/0 (socket says 10.20.193.40:55766) 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f45598b16c0 1 -- 10.20.193.40:0/2058650787 learned_addr learned my addr 10.20.193.40:0/2058650787 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f455a0b26c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f45541110a0 0x7f4554127220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.792+0000 7f45590b06c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f455410c480 0x7f4554121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:06.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f45598b16c0 1 -- 10.20.193.40:0/2058650787 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f45541110a0 msgr2=0x7f4554127220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f45598b16c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f45541110a0 0x7f4554127220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f45598b16c0 1 -- 10.20.193.40:0/2058650787 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f455410c480 msgr2=0x7f4554121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f45598b16c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f455410c480 0x7f4554121e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f45598b16c0 1 -- 10.20.193.40:0/2058650787 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4548009590 con 0x7f455410ba90 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f45598b16c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410ba90 0x7f4554121920 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4544009490 tx=0x7f454400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f4542ffd6c0 1 -- 10.20.193.40:0/2058650787 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4544004a80 con 0x7f455410ba90 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f4542ffd6c0 1 -- 10.20.193.40:0/2058650787 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4544009030 con 0x7f455410ba90 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f4542ffd6c0 1 -- 10.20.193.40:0/2058650787 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4544007440 con 0x7f455410ba90 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4554127e80 con 0x7f455410ba90 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.793+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4554168560 con 0x7f455410ba90 2026-02-13T01:25:06.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.794+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45541280a0 con 0x7f455410ba90 2026-02-13T01:25:06.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.796+0000 7f4542ffd6c0 1 -- 10.20.193.40:0/2058650787 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f4544004060 con 0x7f455410ba90 2026-02-13T01:25:06.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.798+0000 7f4542ffd6c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f45300b5760 0x7f45300d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:06.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.798+0000 7f4542ffd6c0 1 -- 10.20.193.40:0/2058650787 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f45440e3c80 con 0x7f455410ba90 2026-02-13T01:25:06.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.798+0000 7f45590b06c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f45300b5760 0x7f45300d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:06.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.798+0000 7f4542ffd6c0 1 -- 10.20.193.40:0/2058650787 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f45440e4100 con 0x7f455410ba90 2026-02-13T01:25:06.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.798+0000 7f45590b06c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f45300b5760 0x7f45300d5c10 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45541282b0 tx=0x7f45480023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:06.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.923+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4554122a70 con 0x7f455410ba90 2026-02-13T01:25:06.924 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.923+0000 7f4542ffd6c0 1 -- 10.20.193.40:0/2058650787 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f45440a64c0 con 0x7f455410ba90 2026-02-13T01:25:06.924 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:06.924 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f45300b5760 msgr2=0x7f45300d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f45300b5760 0x7f45300d5c10 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45541282b0 tx=0x7f45480023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410ba90 msgr2=0x7f4554121920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410ba90 0x7f4554121920 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4544009490 tx=0x7f454400bca0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 shutdown_connections 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f45300b5760 0x7f45300d5c10 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f45541110a0 0x7f4554127220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f455410c480 0x7f4554121e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 --2- 10.20.193.40:0/2058650787 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f455410ba90 0x7f4554121920 unknown :-1 s=CLOSED pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 >> 10.20.193.40:0/2058650787 conn(0x7f45540e9700 msgr2=0x7f4554109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 shutdown_connections 2026-02-13T01:25:06.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:06.924+0000 7f455bb3c6c0 1 -- 10.20.193.40:0/2058650787 wait complete. 2026-02-13T01:25:06.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:06 trial055 ceph-mon[27509]: pgmap v216: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:07.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:06 trial118 ceph-mon[27812]: pgmap v216: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:07.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:07 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2058650787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:07.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:07 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2058650787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:08.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:07 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2058650787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:08.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:08 trial055 ceph-mon[27509]: pgmap v217: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:08.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:08 trial040 ceph-mon[23046]: pgmap v217: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:09.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:08 trial118 ceph-mon[27812]: pgmap v217: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:09.892 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:09 trial055 ceph-mon[27509]: mgrmap e17: x(active, since 3m), standbys: z, y 2026-02-13T01:25:09.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:09 trial040 ceph-mon[23046]: mgrmap e17: x(active, since 3m), standbys: z, y 2026-02-13T01:25:10.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:09 trial118 ceph-mon[27812]: mgrmap e17: x(active, since 3m), standbys: z, y 2026-02-13T01:25:10.029 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:10.213 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:10.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.406+0000 7f0a26bbe6c0 1 -- 10.20.193.40:0/1656288300 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a2010d7c0 msgr2=0x7f0a20112800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.406+0000 7f0a26bbe6c0 1 --2- 10.20.193.40:0/1656288300 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a2010d7c0 0x7f0a20112800 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=9090765251831814713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a140099a0 tx=0x7f0a1402ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.406+0000 7f0a26bbe6c0 1 -- 10.20.193.40:0/1656288300 shutdown_connections 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.406+0000 7f0a26bbe6c0 1 --2- 10.20.193.40:0/1656288300 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0a20112fe0 0x7f0a20173980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.406+0000 7f0a26bbe6c0 1 --2- 10.20.193.40:0/1656288300 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a2010d7c0 0x7f0a20112800 unknown :-1 s=CLOSED pgs=270 gs=1 cs=0 l=1 c_cookie=9090765251831814713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.406+0000 7f0a26bbe6c0 1 --2- 10.20.193.40:0/1656288300 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0a2010cdd0 0x7f0a2010d1a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.406+0000 7f0a26bbe6c0 1 -- 10.20.193.40:0/1656288300 >> 10.20.193.40:0/1656288300 conn(0x7f0a200ea6d0 msgr2=0x7f0a2010aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.406+0000 7f0a26bbe6c0 1 -- 10.20.193.40:0/1656288300 shutdown_connections 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.406+0000 7f0a26bbe6c0 1 -- 10.20.193.40:0/1656288300 wait complete. 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a26bbe6c0 1 Processor -- start 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a26bbe6c0 1 -- start start 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a26bbe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0a2010cdd0 0x7f0a20062070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a26bbe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a20112fe0 0x7f0a20173880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a26bbe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0a200605e0 0x7f0a20060a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a26bbe6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20060fc0 con 0x7f0a20112fe0 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a26bbe6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20061130 con 0x7f0a200605e0 2026-02-13T01:25:10.408 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a26bbe6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0a200612f0 con 0x7f0a2010cdd0 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a253bb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a20112fe0 0x7f0a20173880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a253bb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a20112fe0 0x7f0a20173880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:33988/0 (socket says 10.20.193.40:33988) 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a253bb6c0 1 -- 10.20.193.40:0/2700901589 learned_addr learned my addr 10.20.193.40:0/2700901589 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.407+0000 7f0a25bbc6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0a2010cdd0 0x7f0a20062070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a263bd6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0a200605e0 0x7f0a20060a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a253bb6c0 1 -- 10.20.193.40:0/2700901589 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0a2010cdd0 msgr2=0x7f0a20062070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a253bb6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0a2010cdd0 0x7f0a20062070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a253bb6c0 1 -- 10.20.193.40:0/2700901589 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0a200605e0 msgr2=0x7f0a20060a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a253bb6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0a200605e0 0x7f0a20060a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a253bb6c0 1 -- 10.20.193.40:0/2700901589 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a14009590 con 0x7f0a20112fe0 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a263bd6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0a200605e0 0x7f0a20060a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a25bbc6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0a2010cdd0 0x7f0a20062070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:10.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a253bb6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a20112fe0 0x7f0a20173880 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a14005b40 tx=0x7f0a1402f560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:10.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a0effd6c0 1 -- 10.20.193.40:0/2700901589 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a1402fdc0 con 0x7f0a20112fe0 2026-02-13T01:25:10.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a0effd6c0 1 -- 10.20.193.40:0/2700901589 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0a14002be0 con 0x7f0a20112fe0 2026-02-13T01:25:10.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a0effd6c0 1 -- 10.20.193.40:0/2700901589 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a14007430 con 0x7f0a20112fe0 2026-02-13T01:25:10.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a26bbe6c0 1 -- 10.20.193.40:0/2700901589 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a200ff200 con 0x7f0a20112fe0 2026-02-13T01:25:10.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.408+0000 7f0a26bbe6c0 1 -- 10.20.193.40:0/2700901589 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a200ff630 con 0x7f0a20112fe0 2026-02-13T01:25:10.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.409+0000 7f0a0cff96c0 1 -- 10.20.193.40:0/2700901589 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a200614b0 con 0x7f0a20112fe0 2026-02-13T01:25:10.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.411+0000 7f0a0effd6c0 1 -- 10.20.193.40:0/2700901589 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0a140026b0 con 0x7f0a20112fe0 2026-02-13T01:25:10.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.412+0000 7f0a0effd6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f09fc0b56d0 0x7f09fc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.412+0000 7f0a0effd6c0 1 -- 10.20.193.40:0/2700901589 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f0a14107c50 con 0x7f0a20112fe0 2026-02-13T01:25:10.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.412+0000 7f0a0effd6c0 1 -- 10.20.193.40:0/2700901589 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0a141080d0 con 0x7f0a20112fe0 2026-02-13T01:25:10.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.412+0000 7f0a25bbc6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f09fc0b56d0 0x7f09fc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.414 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.413+0000 7f0a25bbc6c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f09fc0b56d0 0x7f09fc0d5b80 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a10004750 tx=0x7f0a10009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:10.538 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.536+0000 7f0a0cff96c0 1 -- 10.20.193.40:0/2700901589 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0a200614b0 con 0x7f0a20112fe0 2026-02-13T01:25:10.538 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.537+0000 7f0a0effd6c0 1 -- 10.20.193.40:0/2700901589 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0a200614b0 con 0x7f0a20112fe0 2026-02-13T01:25:10.538 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:10.538 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:10.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 -- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f09fc0b56d0 msgr2=0x7f09fc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f09fc0b56d0 0x7f09fc0d5b80 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a10004750 tx=0x7f0a10009260 comp rx=0 tx=0).stop 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 -- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a20112fe0 msgr2=0x7f0a20173880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a20112fe0 0x7f0a20173880 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a14005b40 tx=0x7f0a1402f560 comp rx=0 tx=0).stop 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 -- 10.20.193.40:0/2700901589 shutdown_connections 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f09fc0b56d0 0x7f09fc0d5b80 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0a200605e0 0x7f0a20060a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0a20112fe0 0x7f0a20173880 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 --2- 10.20.193.40:0/2700901589 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0a2010cdd0 0x7f0a20062070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 -- 10.20.193.40:0/2700901589 >> 10.20.193.40:0/2700901589 conn(0x7f0a200ea6d0 msgr2=0x7f0a20111660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 -- 10.20.193.40:0/2700901589 shutdown_connections 2026-02-13T01:25:10.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:10.538+0000 7f0a0cff96c0 1 -- 10.20.193.40:0/2700901589 wait complete. 2026-02-13T01:25:10.597 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:10 trial040 ceph-mon[23046]: pgmap v218: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T01:25:10.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:10 trial055 ceph-mon[27509]: pgmap v218: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T01:25:11.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:10 trial118 ceph-mon[27812]: pgmap v218: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T01:25:11.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:11 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2700901589' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:11.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:11 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2700901589' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:12.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:11 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2700901589' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:12.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:12 trial055 ceph-mon[27509]: pgmap v219: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T01:25:12.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:12 trial040 ceph-mon[23046]: pgmap v219: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T01:25:13.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:12 trial118 ceph-mon[27812]: pgmap v219: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T01:25:13.642 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:13.826 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:14.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.023+0000 7f697ba986c0 1 -- 10.20.193.40:0/2636066441 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f697410fbf0 msgr2=0x7f6974114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.023+0000 7f697ba986c0 1 --2- 10.20.193.40:0/2636066441 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f697410fbf0 0x7f6974114c30 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=17594885325756572621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69680099a0 tx=0x7f696802ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:14.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.023+0000 7f697ba986c0 1 -- 10.20.193.40:0/2636066441 shutdown_connections 2026-02-13T01:25:14.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.023+0000 7f697ba986c0 1 --2- 10.20.193.40:0/2636066441 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f6974115410 0x7f6974175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.023+0000 7f697ba986c0 1 --2- 10.20.193.40:0/2636066441 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f697410fbf0 0x7f6974114c30 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=17594885325756572621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.023+0000 7f697ba986c0 1 --2- 10.20.193.40:0/2636066441 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f697410f200 0x7f697410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.023+0000 7f697ba986c0 1 -- 10.20.193.40:0/2636066441 >> 10.20.193.40:0/2636066441 conn(0x7f69740ecb00 msgr2=0x7f697410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:14.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.023+0000 7f697ba986c0 1 -- 10.20.193.40:0/2636066441 shutdown_connections 2026-02-13T01:25:14.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.023+0000 7f697ba986c0 1 -- 10.20.193.40:0/2636066441 wait complete. 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697ba986c0 1 Processor -- start 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697ba986c0 1 -- start start 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697ba986c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f697410f200 0x7f69740f4990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697ba986c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6974115410 0x7f6974175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697ba986c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f69740f4fc0 0x7f69740fa240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697ba986c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69740f5620 con 0x7f6974115410 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697ba986c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f69740fa780 con 0x7f697410f200 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697ba986c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f69740fa940 con 0x7f69740f4fc0 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697900c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6974115410 0x7f6974175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697980d6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f697410f200 0x7f69740f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697900c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6974115410 0x7f6974175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:34002/0 (socket says 10.20.193.40:34002) 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.024+0000 7f697900c6c0 1 -- 10.20.193.40:0/4130182989 learned_addr learned my addr 10.20.193.40:0/4130182989 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:14.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f697a00e6c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f69740f4fc0 0x7f69740fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f697900c6c0 1 -- 10.20.193.40:0/4130182989 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f69740f4fc0 msgr2=0x7f69740fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f697900c6c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f69740f4fc0 0x7f69740fa240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f697900c6c0 1 -- 10.20.193.40:0/4130182989 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f697410f200 msgr2=0x7f69740f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f697900c6c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f697410f200 0x7f69740f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f697900c6c0 1 -- 10.20.193.40:0/4130182989 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6968009590 con 0x7f6974115410 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f697900c6c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6974115410 0x7f6974175cb0 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6968005b40 tx=0x7f69680047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f6962ffd6c0 1 -- 10.20.193.40:0/4130182989 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f696802f9d0 con 0x7f6974115410 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f6962ffd6c0 1 -- 10.20.193.40:0/4130182989 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6968002be0 con 0x7f6974115410 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f6962ffd6c0 1 -- 10.20.193.40:0/4130182989 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6968007670 con 0x7f6974115410 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69740fab60 con 0x7f6974115410 2026-02-13T01:25:14.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.025+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69740faf90 con 0x7f6974115410 2026-02-13T01:25:14.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.026+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69741104d0 con 0x7f6974115410 2026-02-13T01:25:14.029 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.028+0000 7f6962ffd6c0 1 -- 10.20.193.40:0/4130182989 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6968031030 con 0x7f6974115410 2026-02-13T01:25:14.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.030+0000 7f6962ffd6c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f69500b5650 0x7f69500d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.030+0000 7f6962ffd6c0 1 -- 10.20.193.40:0/4130182989 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f6968107f10 con 0x7f6974115410 2026-02-13T01:25:14.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.030+0000 7f697980d6c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f69500b5650 0x7f69500d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.030+0000 7f6962ffd6c0 1 -- 10.20.193.40:0/4130182989 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f69680ca8b0 con 0x7f6974115410 2026-02-13T01:25:14.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.030+0000 7f697980d6c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f69500b5650 0x7f69500d5b00 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6964004750 tx=0x7f6964009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:14.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.154+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f697410f5d0 con 0x7f6974115410 2026-02-13T01:25:14.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.154+0000 7f6962ffd6c0 1 -- 10.20.193.40:0/4130182989 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f69680cda60 con 0x7f6974115410 2026-02-13T01:25:14.155 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:14.155 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f69500b5650 msgr2=0x7f69500d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f69500b5650 0x7f69500d5b00 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6964004750 tx=0x7f6964009310 comp rx=0 tx=0).stop 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6974115410 msgr2=0x7f6974175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6974115410 0x7f6974175cb0 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6968005b40 tx=0x7f69680047f0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 shutdown_connections 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f69500b5650 0x7f69500d5b00 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f69740f4fc0 0x7f69740fa240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6974115410 0x7f6974175cb0 unknown :-1 s=CLOSED pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 --2- 10.20.193.40:0/4130182989 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f697410f200 0x7f69740f4990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 >> 10.20.193.40:0/4130182989 conn(0x7f69740ecb00 msgr2=0x7f697410d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 shutdown_connections 2026-02-13T01:25:14.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:14.155+0000 7f697ba986c0 1 -- 10.20.193.40:0/4130182989 wait complete. 2026-02-13T01:25:14.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:14 trial055 ceph-mon[27509]: pgmap v220: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T01:25:14.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:14 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4130182989' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:14.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:14 trial040 ceph-mon[23046]: pgmap v220: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T01:25:14.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:14 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4130182989' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:15.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:14 trial118 ceph-mon[27812]: pgmap v220: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T01:25:15.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:14 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4130182989' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:16.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:16 trial055 ceph-mon[27509]: pgmap v221: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T01:25:16.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:16 trial040 ceph-mon[23046]: pgmap v221: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T01:25:17.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:16 trial118 ceph-mon[27812]: pgmap v221: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T01:25:17.262 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:17.447 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:17.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.642+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/3703627987 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc10fbf0 msgr2=0x7f06bc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.642+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/3703627987 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc10fbf0 0x7f06bc114c30 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=10568099909368090299 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06b00099a0 tx=0x7f06b002ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:17.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.642+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/3703627987 shutdown_connections 2026-02-13T01:25:17.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.642+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/3703627987 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f06bc115410 0x7f06bc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.642+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/3703627987 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc10fbf0 0x7f06bc114c30 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=10568099909368090299 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.642+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/3703627987 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f06bc10f200 0x7f06bc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.642+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/3703627987 >> 10.20.193.40:0/3703627987 conn(0x7f06bc0ecb00 msgr2=0x7f06bc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:17.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.642+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/3703627987 shutdown_connections 2026-02-13T01:25:17.643 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.642+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/3703627987 wait complete. 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c46bb6c0 1 Processor -- start 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c46bb6c0 1 -- start start 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c46bb6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f06bc10f200 0x7f06bc0f49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c46bb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc115410 0x7f06bc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c46bb6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f06bc0f5000 0x7f06bc0fa2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c46bb6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f06bc0f56f0 con 0x7f06bc115410 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c46bb6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f06bc0fa810 con 0x7f06bc0f5000 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c46bb6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f06bc0fa9d0 con 0x7f06bc10f200 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c1c2b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc115410 0x7f06bc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c1c2b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc115410 0x7f06bc175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:34014/0 (socket says 10.20.193.40:34014) 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c1c2b6c0 1 -- 10.20.193.40:0/2878516006 learned_addr learned my addr 10.20.193.40:0/2878516006 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c2c2d6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f06bc0f5000 0x7f06bc0fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.644 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.643+0000 7f06c242c6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f06bc10f200 0x7f06bc0f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06c1c2b6c0 1 -- 10.20.193.40:0/2878516006 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f06bc10f200 msgr2=0x7f06bc0f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06c1c2b6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f06bc10f200 0x7f06bc0f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06c1c2b6c0 1 -- 10.20.193.40:0/2878516006 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f06bc0f5000 msgr2=0x7f06bc0fa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06c1c2b6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f06bc0f5000 0x7f06bc0fa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06c1c2b6c0 1 -- 10.20.193.40:0/2878516006 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b0009590 con 0x7f06bc115410 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06c1c2b6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc115410 0x7f06bc175cb0 secure :-1 s=READY pgs=275 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06b00092e0 tx=0x7f06b002f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06a37fe6c0 1 -- 10.20.193.40:0/2878516006 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f06b00046b0 con 0x7f06bc115410 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06a37fe6c0 1 -- 10.20.193.40:0/2878516006 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f06b0002be0 con 0x7f06bc115410 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06a37fe6c0 1 -- 10.20.193.40:0/2878516006 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f06b0007670 con 0x7f06bc115410 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06bc0fac50 con 0x7f06bc115410 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.644+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06bc0fb080 con 0x7f06bc115410 2026-02-13T01:25:17.645 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.645+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06bc1104d0 con 0x7f06bc115410 2026-02-13T01:25:17.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.647+0000 7f06a37fe6c0 1 -- 10.20.193.40:0/2878516006 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f06b00026b0 con 0x7f06bc115410 2026-02-13T01:25:17.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.648+0000 7f06a37fe6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f068c0b56d0 0x7f068c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.648+0000 7f06a37fe6c0 1 -- 10.20.193.40:0/2878516006 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f06b0107b60 con 0x7f06bc115410 2026-02-13T01:25:17.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.648+0000 7f06c242c6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f068c0b56d0 0x7f068c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.648+0000 7f06a37fe6c0 1 -- 10.20.193.40:0/2878516006 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f06b01405e0 con 0x7f06bc115410 2026-02-13T01:25:17.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.649+0000 7f06c242c6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f068c0b56d0 0x7f068c0d5b80 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06ac004750 tx=0x7f06ac009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:17.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.772+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f06bc10f5d0 con 0x7f06bc115410 2026-02-13T01:25:17.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.773+0000 7f06a37fe6c0 1 -- 10.20.193.40:0/2878516006 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f06b00ca500 con 0x7f06bc115410 2026-02-13T01:25:17.774 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:17.774 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f068c0b56d0 msgr2=0x7f068c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f068c0b56d0 0x7f068c0d5b80 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06ac004750 tx=0x7f06ac009260 comp rx=0 tx=0).stop 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc115410 msgr2=0x7f06bc175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc115410 0x7f06bc175cb0 secure :-1 s=READY pgs=275 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06b00092e0 tx=0x7f06b002f810 comp rx=0 tx=0).stop 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 shutdown_connections 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f068c0b56d0 0x7f068c0d5b80 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f06bc0f5000 0x7f06bc0fa2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f06bc115410 0x7f06bc175cb0 unknown :-1 s=CLOSED pgs=275 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 --2- 10.20.193.40:0/2878516006 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f06bc10f200 0x7f06bc0f49d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 >> 10.20.193.40:0/2878516006 conn(0x7f06bc0ecb00 msgr2=0x7f06bc10d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 shutdown_connections 2026-02-13T01:25:17.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:17.774+0000 7f06c46bb6c0 1 -- 10.20.193.40:0/2878516006 wait complete. 2026-02-13T01:25:18.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:18 trial055 ceph-mon[27509]: pgmap v222: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T01:25:18.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:18 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2878516006' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:18.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:18 trial040 ceph-mon[23046]: pgmap v222: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T01:25:18.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:18 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2878516006' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:19.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:18 trial118 ceph-mon[27812]: pgmap v222: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T01:25:19.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:18 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2878516006' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:20.913 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:20.965 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:20 trial040 ceph-mon[23046]: pgmap v223: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T01:25:20.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:20 trial055 ceph-mon[27509]: pgmap v223: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T01:25:21.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:20 trial118 ceph-mon[27812]: pgmap v223: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T01:25:21.100 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:21.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.285+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/122635293 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe39410fbf0 msgr2=0x7fe394114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.285+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/122635293 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe39410fbf0 0x7fe394114c30 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=1589328154797366918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3840099a0 tx=0x7fe38402ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:21.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.285+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/122635293 shutdown_connections 2026-02-13T01:25:21.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.285+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/122635293 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe394115410 0x7fe394175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.285+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/122635293 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe39410fbf0 0x7fe394114c30 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=1589328154797366918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.285+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/122635293 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe39410f200 0x7fe39410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.285+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/122635293 >> 10.20.193.40:0/122635293 conn(0x7fe3940ecb00 msgr2=0x7fe39410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.285+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/122635293 shutdown_connections 2026-02-13T01:25:21.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.285+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/122635293 wait complete. 2026-02-13T01:25:21.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe39a0f86c0 1 Processor -- start 2026-02-13T01:25:21.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe39a0f86c0 1 -- start start 2026-02-13T01:25:21.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe39a0f86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe39410f200 0x7fe3940f4990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe39a0f86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe394115410 0x7fe394175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe39a0f86c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3940f4fc0 0x7fe3940fa240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe39a0f86c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3940f56b0 con 0x7fe394115410 2026-02-13T01:25:21.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe39a0f86c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe3940fa780 con 0x7fe39410f200 2026-02-13T01:25:21.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe39a0f86c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe3940fa940 con 0x7fe3940f4fc0 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe3937fe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe39410f200 0x7fe3940f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe392ffd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe394115410 0x7fe394175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe3937fe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe39410f200 0x7fe3940f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:59244/0 (socket says 10.20.193.40:59244) 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe3937fe6c0 1 -- 10.20.193.40:0/3510945564 learned_addr learned my addr 10.20.193.40:0/3510945564 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe393fff6c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3940f4fc0 0x7fe3940fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe3937fe6c0 1 -- 10.20.193.40:0/3510945564 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3940f4fc0 msgr2=0x7fe3940fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe3937fe6c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3940f4fc0 0x7fe3940fa240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe3937fe6c0 1 -- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe394115410 msgr2=0x7fe394175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe3937fe6c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe394115410 0x7fe394175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe3937fe6c0 1 -- 10.20.193.40:0/3510945564 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe384009590 con 0x7fe39410f200 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.286+0000 7fe392ffd6c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe394115410 0x7fe394175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:21.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.287+0000 7fe3937fe6c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe39410f200 0x7fe3940f4990 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe380009fd0 tx=0x7fe38000bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.287+0000 7fe390ff96c0 1 -- 10.20.193.40:0/3510945564 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe380004a80 con 0x7fe39410f200 2026-02-13T01:25:21.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.287+0000 7fe390ff96c0 1 -- 10.20.193.40:0/3510945564 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe380009030 con 0x7fe39410f200 2026-02-13T01:25:21.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.287+0000 7fe390ff96c0 1 -- 10.20.193.40:0/3510945564 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3800071c0 con 0x7fe39410f200 2026-02-13T01:25:21.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.287+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3940fac20 con 0x7fe39410f200 2026-02-13T01:25:21.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.287+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3940fb0b0 con 0x7fe39410f200 2026-02-13T01:25:21.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.287+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3941104d0 con 0x7fe39410f200 2026-02-13T01:25:21.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.290+0000 7fe390ff96c0 1 -- 10.20.193.40:0/3510945564 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe38000c740 con 0x7fe39410f200 2026-02-13T01:25:21.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.291+0000 7fe390ff96c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe3680b56d0 0x7fe3680d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.293 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.292+0000 7fe390ff96c0 1 -- 10.20.193.40:0/3510945564 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fe3800e3aa0 con 0x7fe39410f200 2026-02-13T01:25:21.293 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.292+0000 7fe392ffd6c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe3680b56d0 0x7fe3680d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.293 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.292+0000 7fe390ff96c0 1 -- 10.20.193.40:0/3510945564 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe38011c5e0 con 0x7fe39410f200 2026-02-13T01:25:21.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.292+0000 7fe392ffd6c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe3680b56d0 0x7fe3680d5b80 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3840023e0 tx=0x7fe384007260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.416+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe39410f5d0 con 0x7fe39410f200 2026-02-13T01:25:21.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.416+0000 7fe390ff96c0 1 -- 10.20.193.40:0/3510945564 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe3800a6440 con 0x7fe39410f200 2026-02-13T01:25:21.418 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:21.418 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:21.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe3680b56d0 msgr2=0x7fe3680d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe3680b56d0 0x7fe3680d5b80 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3840023e0 tx=0x7fe384007260 comp rx=0 tx=0).stop 2026-02-13T01:25:21.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe39410f200 msgr2=0x7fe3940f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe39410f200 0x7fe3940f4990 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe380009fd0 tx=0x7fe38000bca0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 shutdown_connections 2026-02-13T01:25:21.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe3680b56d0 0x7fe3680d5b80 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3940f4fc0 0x7fe3940fa240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe394115410 0x7fe394175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 --2- 10.20.193.40:0/3510945564 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe39410f200 0x7fe3940f4990 unknown :-1 s=CLOSED pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 >> 10.20.193.40:0/3510945564 conn(0x7fe3940ecb00 msgr2=0x7fe39410d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 shutdown_connections 2026-02-13T01:25:21.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:21.417+0000 7fe39a0f86c0 1 -- 10.20.193.40:0/3510945564 wait complete. 2026-02-13T01:25:21.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:21 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3510945564' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:21.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:21 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3510945564' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:22.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:21 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3510945564' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:22.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:22 trial055 ceph-mon[27509]: pgmap v224: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-13T01:25:22.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:22 trial040 ceph-mon[23046]: pgmap v224: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-13T01:25:23.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:22 trial118 ceph-mon[27812]: pgmap v224: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-13T01:25:24.523 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:24.707 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:24.802 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:24 trial040 ceph-mon[23046]: pgmap v225: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:24.897 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.896+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/3926762085 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa28115270 msgr2=0x7ffa28175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.896+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/3926762085 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa28115270 0x7ffa28175c10 secure :-1 s=READY pgs=277 gs=3 cs=0 l=1 c_cookie=17329829296343647227 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa2400a9b0 tx=0x7ffa2402fd20 comp rx=0 tx=0).stop 2026-02-13T01:25:24.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.896+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/3926762085 shutdown_connections 2026-02-13T01:25:24.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.896+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/3926762085 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa28115270 0x7ffa28175c10 unknown :-1 s=CLOSED pgs=277 gs=3 cs=0 l=1 c_cookie=17329829296343647227 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.896+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/3926762085 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa2810fa50 0x7ffa28114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.896+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/3926762085 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa2810f060 0x7ffa2810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.896+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/3926762085 >> 10.20.193.40:0/3926762085 conn(0x7ffa280ec980 msgr2=0x7ffa2810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:24.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.896+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/3926762085 shutdown_connections 2026-02-13T01:25:24.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.896+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/3926762085 wait complete. 2026-02-13T01:25:24.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2e2336c0 1 Processor -- start 2026-02-13T01:25:24.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2e2336c0 1 -- start start 2026-02-13T01:25:24.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2e2336c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa2810f060 0x7ffa2811cdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2e2336c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa28115270 0x7ffa2811d300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2e2336c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa28122670 0x7ffa28122b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2e2336c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffa28123080 con 0x7ffa2810f060 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2e2336c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281231f0 con 0x7ffa28115270 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2e2336c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281233b0 con 0x7ffa28122670 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2d2316c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa2810f060 0x7ffa2811cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2d2316c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa2810f060 0x7ffa2811cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:45552/0 (socket says 10.20.193.40:45552) 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2d2316c0 1 -- 10.20.193.40:0/231943078 learned_addr learned my addr 10.20.193.40:0/231943078 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2ca306c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa28115270 0x7ffa2811d300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.897+0000 7ffa2da326c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa28122670 0x7ffa28122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa2d2316c0 1 -- 10.20.193.40:0/231943078 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa28122670 msgr2=0x7ffa28122b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa2d2316c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa28122670 0x7ffa28122b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa2d2316c0 1 -- 10.20.193.40:0/231943078 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa28115270 msgr2=0x7ffa2811d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa2d2316c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa28115270 0x7ffa2811d300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa2d2316c0 1 -- 10.20.193.40:0/231943078 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2400a5b0 con 0x7ffa2810f060 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa2d2316c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa2810f060 0x7ffa2811cdc0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa18009490 tx=0x7ffa1800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa167fc6c0 1 -- 10.20.193.40:0/231943078 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa18004a80 con 0x7ffa2810f060 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa28163860 con 0x7ffa2810f060 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa167fc6c0 1 -- 10.20.193.40:0/231943078 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ffa18009030 con 0x7ffa2810f060 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa167fc6c0 1 -- 10.20.193.40:0/231943078 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa18004a80 con 0x7ffa2810f060 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.898+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa28163cf0 con 0x7ffa2810f060 2026-02-13T01:25:24.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.899+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa28110330 con 0x7ffa2810f060 2026-02-13T01:25:24.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.901+0000 7ffa167fc6c0 1 -- 10.20.193.40:0/231943078 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ffa18004e90 con 0x7ffa2810f060 2026-02-13T01:25:24.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.902+0000 7ffa167fc6c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa040b5730 0x7ffa040d5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.902+0000 7ffa167fc6c0 1 -- 10.20.193.40:0/231943078 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7ffa180e3970 con 0x7ffa2810f060 2026-02-13T01:25:24.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.903+0000 7ffa2ca306c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa040b5730 0x7ffa040d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.903+0000 7ffa2ca306c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa040b5730 0x7ffa040d5be0 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa28123700 tx=0x7ffa1c009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:24.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:24.903+0000 7ffa167fc6c0 1 -- 10.20.193.40:0/231943078 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffa180a6310 con 0x7ffa2810f060 2026-02-13T01:25:24.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:24 trial055 ceph-mon[27509]: pgmap v225: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:25.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:24 trial118 ceph-mon[27812]: pgmap v225: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:25.029 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.028+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffa2810fa50 con 0x7ffa2810f060 2026-02-13T01:25:25.030 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.028+0000 7ffa167fc6c0 1 -- 10.20.193.40:0/231943078 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ffa180a94c0 con 0x7ffa2810f060 2026-02-13T01:25:25.030 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:25.030 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:25.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.029+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa040b5730 msgr2=0x7ffa040d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.029+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa040b5730 0x7ffa040d5be0 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa28123700 tx=0x7ffa1c009310 comp rx=0 tx=0).stop 2026-02-13T01:25:25.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.029+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa2810f060 msgr2=0x7ffa2811cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.029+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa2810f060 0x7ffa2811cdc0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa18009490 tx=0x7ffa1800bc50 comp rx=0 tx=0).stop 2026-02-13T01:25:25.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.030+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 shutdown_connections 2026-02-13T01:25:25.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.030+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffa040b5730 0x7ffa040d5be0 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.030+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffa28122670 0x7ffa28122b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.031 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.030+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffa28115270 0x7ffa2811d300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.032 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.030+0000 7ffa2e2336c0 1 --2- 10.20.193.40:0/231943078 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffa2810f060 0x7ffa2811cdc0 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.032 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.030+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 >> 10.20.193.40:0/231943078 conn(0x7ffa280ec980 msgr2=0x7ffa2810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.032 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.030+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 shutdown_connections 2026-02-13T01:25:25.032 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:25.030+0000 7ffa2e2336c0 1 -- 10.20.193.40:0/231943078 wait complete. 2026-02-13T01:25:25.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:25 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/231943078' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:25.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:25 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/231943078' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:26.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:25 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/231943078' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:26.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:26 trial055 ceph-mon[27509]: pgmap v226: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:26.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:26 trial040 ceph-mon[23046]: pgmap v226: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:27.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:26 trial118 ceph-mon[27812]: pgmap v226: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:28.133 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:28.318 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:28.503 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.501+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1942494421 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f2410fa50 msgr2=0x7f3f24114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.503 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.501+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1942494421 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f2410fa50 0x7f3f24114a90 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=12643573231661598131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f180099a0 tx=0x7f3f1802ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:28.503 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.501+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1942494421 shutdown_connections 2026-02-13T01:25:28.503 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.501+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1942494421 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3f24115270 0x7f3f24175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.503 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.501+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1942494421 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f2410fa50 0x7f3f24114a90 unknown :-1 s=CLOSED pgs=279 gs=1 cs=0 l=1 c_cookie=12643573231661598131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.503 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.501+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1942494421 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3f2410f060 0x7f3f2410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.504 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.501+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1942494421 >> 10.20.193.40:0/1942494421 conn(0x7f3f240ec980 msgr2=0x7f3f2410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:28.504 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.501+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1942494421 shutdown_connections 2026-02-13T01:25:28.504 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.502+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1942494421 wait complete. 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.502+0000 7f3f2a74b6c0 1 Processor -- start 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.502+0000 7f3f2a74b6c0 1 -- start start 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f2a74b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3f2410f060 0x7f3f240f49b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f2a74b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3f24115270 0x7f3f24175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f2a74b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f240f4fe0 0x7f3f240fa2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f2a74b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3f240f56d0 con 0x7f3f240f4fe0 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f2a74b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3f240fa7f0 con 0x7f3f24115270 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f2a74b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3f240fa9b0 con 0x7f3f2410f060 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f29f4a6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f240f4fe0 0x7f3f240fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.506 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f297496c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3f2410f060 0x7f3f240f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f29f4a6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f240f4fe0 0x7f3f240fa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:45582/0 (socket says 10.20.193.40:45582) 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f29f4a6c0 1 -- 10.20.193.40:0/1138383174 learned_addr learned my addr 10.20.193.40:0/1138383174 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f28f486c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3f24115270 0x7f3f24175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f29f4a6c0 1 -- 10.20.193.40:0/1138383174 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3f2410f060 msgr2=0x7f3f240f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f29f4a6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3f2410f060 0x7f3f240f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f29f4a6c0 1 -- 10.20.193.40:0/1138383174 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3f24115270 msgr2=0x7f3f24175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f29f4a6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3f24115270 0x7f3f24175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f29f4a6c0 1 -- 10.20.193.40:0/1138383174 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f18009590 con 0x7f3f240f4fe0 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f29f4a6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f240f4fe0 0x7f3f240fa2b0 secure :-1 s=READY pgs=280 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f20006ea0 tx=0x7f3f2000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f127fc6c0 1 -- 10.20.193.40:0/1138383174 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f20003a30 con 0x7f3f240f4fe0 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f127fc6c0 1 -- 10.20.193.40:0/1138383174 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3f20005560 con 0x7f3f240f4fe0 2026-02-13T01:25:28.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f127fc6c0 1 -- 10.20.193.40:0/1138383174 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f200082a0 con 0x7f3f240f4fe0 2026-02-13T01:25:28.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.503+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f240fac90 con 0x7f3f240f4fe0 2026-02-13T01:25:28.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.504+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f240fb120 con 0x7f3f240f4fe0 2026-02-13T01:25:28.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.504+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f24110330 con 0x7f3f240f4fe0 2026-02-13T01:25:28.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.506+0000 7f3f127fc6c0 1 -- 10.20.193.40:0/1138383174 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f3f2000d4d0 con 0x7f3f240f4fe0 2026-02-13T01:25:28.509 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.508+0000 7f3f127fc6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3f000b56d0 0x7f3f000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.508+0000 7f3f127fc6c0 1 -- 10.20.193.40:0/1138383174 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f3f200e4850 con 0x7f3f240f4fe0 2026-02-13T01:25:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.508+0000 7f3f297496c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3f000b56d0 0x7f3f000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.508+0000 7f3f127fc6c0 1 -- 10.20.193.40:0/1138383174 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3f200e4cd0 con 0x7f3f240f4fe0 2026-02-13T01:25:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.509+0000 7f3f297496c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3f000b56d0 0x7f3f000d5b80 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f14004750 tx=0x7f3f14009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:28.634 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.633+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3f240f5b30 con 0x7f3f240f4fe0 2026-02-13T01:25:28.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.633+0000 7f3f127fc6c0 1 -- 10.20.193.40:0/1138383174 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3f200a71f0 con 0x7f3f240f4fe0 2026-02-13T01:25:28.635 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:28.635 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:28.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.634+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3f000b56d0 msgr2=0x7f3f000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.634+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3f000b56d0 0x7f3f000d5b80 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f14004750 tx=0x7f3f14009390 comp rx=0 tx=0).stop 2026-02-13T01:25:28.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.634+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f240f4fe0 msgr2=0x7f3f240fa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.634+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f240f4fe0 0x7f3f240fa2b0 secure :-1 s=READY pgs=280 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f20006ea0 tx=0x7f3f2000cca0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.636 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.635+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 shutdown_connections 2026-02-13T01:25:28.637 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.635+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3f000b56d0 0x7f3f000d5b80 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.637 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.635+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3f240f4fe0 0x7f3f240fa2b0 unknown :-1 s=CLOSED pgs=280 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.637 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.635+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3f24115270 0x7f3f24175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.637 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.635+0000 7f3f2a74b6c0 1 --2- 10.20.193.40:0/1138383174 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3f2410f060 0x7f3f240f49b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.637 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.635+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 >> 10.20.193.40:0/1138383174 conn(0x7f3f240ec980 msgr2=0x7f3f2410d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:28.637 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.635+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 shutdown_connections 2026-02-13T01:25:28.637 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:28.635+0000 7f3f2a74b6c0 1 -- 10.20.193.40:0/1138383174 wait complete. 2026-02-13T01:25:28.714 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:28 trial040 ceph-mon[23046]: pgmap v227: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:28.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:28 trial055 ceph-mon[27509]: pgmap v227: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:29.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:28 trial118 ceph-mon[27812]: pgmap v227: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:29.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:29 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1138383174' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:29.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:29 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1138383174' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:30.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:29 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1138383174' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:30.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:30 trial055 ceph-mon[27509]: pgmap v228: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:25:30.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:30 trial040 ceph-mon[23046]: pgmap v228: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:25:31.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:30 trial118 ceph-mon[27812]: pgmap v228: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:25:31.775 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:31.960 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:32.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3933993861 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c010f060 msgr2=0x7fe3c010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3933993861 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c010f060 0x7fe3c010f430 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=63418488721579705 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3b00099a0 tx=0x7fe3b002ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3933993861 shutdown_connections 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3933993861 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3c0115270 0x7fe3c0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3933993861 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe3c010fa50 0x7fe3c0114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3933993861 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c010f060 0x7fe3c010f430 unknown :-1 s=CLOSED pgs=281 gs=1 cs=0 l=1 c_cookie=63418488721579705 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3933993861 >> 10.20.193.40:0/3933993861 conn(0x7fe3c00ec980 msgr2=0x7fe3c010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3933993861 shutdown_connections 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3933993861 wait complete. 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.158+0000 7fe3c5d0b6c0 1 Processor -- start 2026-02-13T01:25:32.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c5d0b6c0 1 -- start start 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c5d0b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3c010f060 0x7fe3c011ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c5d0b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c0115270 0x7fe3c011d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c5d0b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe3c0122700 0x7fe3c0122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c5d0b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01230e0 con 0x7fe3c0115270 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c5d0b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0123250 con 0x7fe3c0122700 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c5d0b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0123410 con 0x7fe3c010f060 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3b7fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c0115270 0x7fe3c011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3b7fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c0115270 0x7fe3c011d340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:42288/0 (socket says 10.20.193.40:42288) 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3b7fff6c0 1 -- 10.20.193.40:0/3264406919 learned_addr learned my addr 10.20.193.40:0/3264406919 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c4d096c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3c010f060 0x7fe3c011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:32.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c550a6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe3c0122700 0x7fe3c0122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:32.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3b7fff6c0 1 -- 10.20.193.40:0/3264406919 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3c010f060 msgr2=0x7fe3c011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3b7fff6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3c010f060 0x7fe3c011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3b7fff6c0 1 -- 10.20.193.40:0/3264406919 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe3c0122700 msgr2=0x7fe3c0122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3b7fff6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe3c0122700 0x7fe3c0122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3b7fff6c0 1 -- 10.20.193.40:0/3264406919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b0009590 con 0x7fe3c0115270 2026-02-13T01:25:32.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3c4d096c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3c010f060 0x7fe3c011ce00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:32.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.159+0000 7fe3b7fff6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c0115270 0x7fe3c011d340 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3a800b650 tx=0x7fe3a800bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:32.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.160+0000 7fe3b5ffb6c0 1 -- 10.20.193.40:0/3264406919 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3a80044a0 con 0x7fe3c0115270 2026-02-13T01:25:32.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.160+0000 7fe3b5ffb6c0 1 -- 10.20.193.40:0/3264406919 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe3a8009030 con 0x7fe3c0115270 2026-02-13T01:25:32.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.160+0000 7fe3b5ffb6c0 1 -- 10.20.193.40:0/3264406919 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3a800ce60 con 0x7fe3c0115270 2026-02-13T01:25:32.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.160+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c0163890 con 0x7fe3c0115270 2026-02-13T01:25:32.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.160+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c0163d20 con 0x7fe3c0115270 2026-02-13T01:25:32.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.160+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c0110330 con 0x7fe3c0115270 2026-02-13T01:25:32.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.163+0000 7fe3b5ffb6c0 1 -- 10.20.193.40:0/3264406919 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe3a800c410 con 0x7fe3c0115270 2026-02-13T01:25:32.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.164+0000 7fe3b5ffb6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe39c0b56c0 0x7fe39c0d5b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:32.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.164+0000 7fe3b5ffb6c0 1 -- 10.20.193.40:0/3264406919 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fe3a80e3a50 con 0x7fe3c0115270 2026-02-13T01:25:32.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.164+0000 7fe3b5ffb6c0 1 -- 10.20.193.40:0/3264406919 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe3a811c5e0 con 0x7fe3c0115270 2026-02-13T01:25:32.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.164+0000 7fe3c4d096c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe39c0b56c0 0x7fe39c0d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:32.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.165+0000 7fe3c4d096c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe39c0b56c0 0x7fe39c0d5b70 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3b00023e0 tx=0x7fe3b0031cb0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:32.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.288+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe3c011df50 con 0x7fe3c0115270 2026-02-13T01:25:32.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.288+0000 7fe3b5ffb6c0 1 -- 10.20.193.40:0/3264406919 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe3a80a63f0 con 0x7fe3c0115270 2026-02-13T01:25:32.290 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:32.290 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:32.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe39c0b56c0 msgr2=0x7fe39c0d5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe39c0b56c0 0x7fe39c0d5b70 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3b00023e0 tx=0x7fe3b0031cb0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c0115270 msgr2=0x7fe3c011d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c0115270 0x7fe3c011d340 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3a800b650 tx=0x7fe3a800bb20 comp rx=0 tx=0).stop 2026-02-13T01:25:32.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 shutdown_connections 2026-02-13T01:25:32.291 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe39c0b56c0 0x7fe39c0d5b70 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe3c0122700 0x7fe3c0122ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe3c0115270 0x7fe3c011d340 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 --2- 10.20.193.40:0/3264406919 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe3c010f060 0x7fe3c011ce00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 >> 10.20.193.40:0/3264406919 conn(0x7fe3c00ec980 msgr2=0x7fe3c010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:32.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 shutdown_connections 2026-02-13T01:25:32.292 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:32.290+0000 7fe3c5d0b6c0 1 -- 10.20.193.40:0/3264406919 wait complete. 2026-02-13T01:25:32.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:32 trial040 ceph-mon[23046]: pgmap v229: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:25:32.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:32 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3264406919' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:32.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:32 trial055 ceph-mon[27509]: pgmap v229: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:25:32.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:32 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3264406919' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:33.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:32 trial118 ceph-mon[27812]: pgmap v229: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:25:33.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:32 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3264406919' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:34.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:34 trial055 ceph-mon[27509]: pgmap v230: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:34.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:34 trial040 ceph-mon[23046]: pgmap v230: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:35.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:34 trial118 ceph-mon[27812]: pgmap v230: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:35.393 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:35.578 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:35.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.776+0000 7f91ebfff6c0 1 -- 10.20.193.40:0/3409889044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 msgr2=0x7f91ec175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.776+0000 7f91ebfff6c0 1 --2- 10.20.193.40:0/3409889044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 0x7f91ec175c10 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=10866106726168767471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91dc00aa70 tx=0x7f91dc02fdd0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.776+0000 7f91ebfff6c0 1 -- 10.20.193.40:0/3409889044 shutdown_connections 2026-02-13T01:25:35.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.776+0000 7f91ebfff6c0 1 --2- 10.20.193.40:0/3409889044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 0x7f91ec175c10 unknown :-1 s=CLOSED pgs=283 gs=1 cs=0 l=1 c_cookie=10866106726168767471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.776+0000 7f91ebfff6c0 1 --2- 10.20.193.40:0/3409889044 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f91ec10fa50 0x7f91ec114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.776+0000 7f91ebfff6c0 1 --2- 10.20.193.40:0/3409889044 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f91ec10f060 0x7f91ec10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.776+0000 7f91ebfff6c0 1 -- 10.20.193.40:0/3409889044 >> 10.20.193.40:0/3409889044 conn(0x7f91ec0ec980 msgr2=0x7f91ec10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:35.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.776+0000 7f91ebfff6c0 1 -- 10.20.193.40:0/3409889044 shutdown_connections 2026-02-13T01:25:35.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.776+0000 7f91ebfff6c0 1 -- 10.20.193.40:0/3409889044 wait complete. 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.777+0000 7f91ebfff6c0 1 Processor -- start 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.777+0000 7f91ebfff6c0 1 -- start start 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.777+0000 7f91ebfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f91ec10f060 0x7f91ec1801b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.777+0000 7f91ebfff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 0x7f91ec17d420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.777+0000 7f91ebfff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f91ec17d960 0x7f91ec17de00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.777+0000 7f91ebfff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec158b30 con 0x7f91ec115270 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.777+0000 7f91ebfff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec158ca0 con 0x7f91ec10f060 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.777+0000 7f91ebfff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec158e60 con 0x7f91ec17d960 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.777+0000 7f91ea7fc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 0x7f91ec17d420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ea7fc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 0x7f91ec17d420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:42302/0 (socket says 10.20.193.40:42302) 2026-02-13T01:25:35.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ea7fc6c0 1 -- 10.20.193.40:0/3069345311 learned_addr learned my addr 10.20.193.40:0/3069345311 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91eb7fe6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f91ec17d960 0x7f91ec17de00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91eaffd6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f91ec10f060 0x7f91ec1801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ea7fc6c0 1 -- 10.20.193.40:0/3069345311 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f91ec17d960 msgr2=0x7f91ec17de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ea7fc6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f91ec17d960 0x7f91ec17de00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ea7fc6c0 1 -- 10.20.193.40:0/3069345311 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f91ec10f060 msgr2=0x7f91ec1801b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ea7fc6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f91ec10f060 0x7f91ec1801b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ea7fc6c0 1 -- 10.20.193.40:0/3069345311 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91dc00a660 con 0x7f91ec115270 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ea7fc6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 0x7f91ec17d420 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d4005dc0 tx=0x7f91d400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91c3fff6c0 1 -- 10.20.193.40:0/3069345311 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91d4004250 con 0x7f91ec115270 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91c3fff6c0 1 -- 10.20.193.40:0/3069345311 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f91d4009070 con 0x7f91ec115270 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91c3fff6c0 1 -- 10.20.193.40:0/3069345311 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91d40071c0 con 0x7f91ec115270 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ebfff6c0 1 -- 10.20.193.40:0/3069345311 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ec159140 con 0x7f91ec115270 2026-02-13T01:25:35.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.778+0000 7f91ebfff6c0 1 -- 10.20.193.40:0/3069345311 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ec1595d0 con 0x7f91ec115270 2026-02-13T01:25:35.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.779+0000 7f91ca7fc6c0 1 -- 10.20.193.40:0/3069345311 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91ec110330 con 0x7f91ec115270 2026-02-13T01:25:35.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.781+0000 7f91c3fff6c0 1 -- 10.20.193.40:0/3069345311 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f91d40043b0 con 0x7f91ec115270 2026-02-13T01:25:35.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.783+0000 7f91c3fff6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f91bc0b56d0 0x7f91bc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.783+0000 7f91c3fff6c0 1 -- 10.20.193.40:0/3069345311 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f91d40e3b50 con 0x7f91ec115270 2026-02-13T01:25:35.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.783+0000 7f91c3fff6c0 1 -- 10.20.193.40:0/3069345311 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f91d411c5e0 con 0x7f91ec115270 2026-02-13T01:25:35.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.783+0000 7f91eaffd6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f91bc0b56d0 0x7f91bc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.783+0000 7f91eaffd6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f91bc0b56d0 0x7f91bc0d5b80 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91e0005980 tx=0x7f91e0005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:35.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.907+0000 7f91ca7fc6c0 1 -- 10.20.193.40:0/3069345311 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f91ec10f430 con 0x7f91ec115270 2026-02-13T01:25:35.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.907+0000 7f91c3fff6c0 1 -- 10.20.193.40:0/3069345311 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f91d40a64f0 con 0x7f91ec115270 2026-02-13T01:25:35.908 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:35.908 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:35.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 -- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f91bc0b56d0 msgr2=0x7f91bc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.909 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f91bc0b56d0 0x7f91bc0d5b80 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91e0005980 tx=0x7f91e0005910 comp rx=0 tx=0).stop 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 -- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 msgr2=0x7f91ec17d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 0x7f91ec17d420 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d4005dc0 tx=0x7f91d400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 -- 10.20.193.40:0/3069345311 shutdown_connections 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f91bc0b56d0 0x7f91bc0d5b80 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f91ec17d960 0x7f91ec17de00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91ec115270 0x7f91ec17d420 unknown :-1 s=CLOSED pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 --2- 10.20.193.40:0/3069345311 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f91ec10f060 0x7f91ec1801b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 -- 10.20.193.40:0/3069345311 >> 10.20.193.40:0/3069345311 conn(0x7f91ec0ec980 msgr2=0x7f91ec10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 -- 10.20.193.40:0/3069345311 shutdown_connections 2026-02-13T01:25:35.910 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:35.909+0000 7f91ca7fc6c0 1 -- 10.20.193.40:0/3069345311 wait complete. 2026-02-13T01:25:36.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:36 trial055 ceph-mon[27509]: pgmap v231: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:36.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:36 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3069345311' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:36.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:36 trial040 ceph-mon[23046]: pgmap v231: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:36.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:36 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3069345311' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:37.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:36 trial118 ceph-mon[27812]: pgmap v231: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:37.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:36 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3069345311' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:38.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:38 trial055 ceph-mon[27509]: pgmap v232: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:38.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:38 trial040 ceph-mon[23046]: pgmap v232: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:39.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:38 trial118 ceph-mon[27812]: pgmap v232: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:39.049 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:39.234 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:39.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.425+0000 7f59464676c0 1 -- 10.20.193.40:0/1494783102 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5940155600 msgr2=0x7f59401759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.425+0000 7f59464676c0 1 --2- 10.20.193.40:0/1494783102 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5940155600 0x7f59401759e0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=15407039803087055107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593c00aa40 tx=0x7f593c02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.426+0000 7f59464676c0 1 -- 10.20.193.40:0/1494783102 shutdown_connections 2026-02-13T01:25:39.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.426+0000 7f59464676c0 1 --2- 10.20.193.40:0/1494783102 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5940155600 0x7f59401759e0 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=15407039803087055107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.426+0000 7f59464676c0 1 --2- 10.20.193.40:0/1494783102 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f594010c1e0 0x7f59401550c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.426+0000 7f59464676c0 1 --2- 10.20.193.40:0/1494783102 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f594010b8d0 0x7f594010bca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.426+0000 7f59464676c0 1 -- 10.20.193.40:0/1494783102 >> 10.20.193.40:0/1494783102 conn(0x7f59400e9590 msgr2=0x7f59401099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:39.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.426+0000 7f59464676c0 1 -- 10.20.193.40:0/1494783102 shutdown_connections 2026-02-13T01:25:39.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.426+0000 7f59464676c0 1 -- 10.20.193.40:0/1494783102 wait complete. 2026-02-13T01:25:39.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.426+0000 7f59464676c0 1 Processor -- start 2026-02-13T01:25:39.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.426+0000 7f59464676c0 1 -- start start 2026-02-13T01:25:39.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59464676c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f594010b8d0 0x7f59401600c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:39.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59464676c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f594010c1e0 0x7f5940160600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:39.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59464676c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5940155600 0x7f59401659c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:39.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59464676c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5940165f80 con 0x7f594010b8d0 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59464676c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f59401660f0 con 0x7f5940155600 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59464676c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f59401662b0 con 0x7f594010c1e0 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59454656c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f594010b8d0 0x7f59401600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59454656c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f594010b8d0 0x7f59401600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:42320/0 (socket says 10.20.193.40:42320) 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59454656c0 1 -- 10.20.193.40:0/138129129 learned_addr learned my addr 10.20.193.40:0/138129129 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f5945c666c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5940155600 0x7f59401659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f5944c646c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f594010c1e0 0x7f5940160600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59454656c0 1 -- 10.20.193.40:0/138129129 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f594010c1e0 msgr2=0x7f5940160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59454656c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f594010c1e0 0x7f5940160600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59454656c0 1 -- 10.20.193.40:0/138129129 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5940155600 msgr2=0x7f59401659c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59454656c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5940155600 0x7f59401659c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59454656c0 1 -- 10.20.193.40:0/138129129 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c00a660 con 0x7f594010b8d0 2026-02-13T01:25:39.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.427+0000 7f59454656c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f594010b8d0 0x7f59401600c0 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593000b710 tx=0x7f593000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:39.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.428+0000 7f592e7fc6c0 1 -- 10.20.193.40:0/138129129 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5930004250 con 0x7f594010b8d0 2026-02-13T01:25:39.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.428+0000 7f592e7fc6c0 1 -- 10.20.193.40:0/138129129 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5930009070 con 0x7f594010b8d0 2026-02-13T01:25:39.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.428+0000 7f592e7fc6c0 1 -- 10.20.193.40:0/138129129 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59300071c0 con 0x7f594010b8d0 2026-02-13T01:25:39.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.428+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5940166590 con 0x7f594010b8d0 2026-02-13T01:25:39.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.428+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5940152240 con 0x7f594010b8d0 2026-02-13T01:25:39.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.428+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f594005fb10 con 0x7f594010b8d0 2026-02-13T01:25:39.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.430+0000 7f592e7fc6c0 1 -- 10.20.193.40:0/138129129 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f59300043b0 con 0x7f594010b8d0 2026-02-13T01:25:39.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.432+0000 7f592e7fc6c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f591c0b56d0 0x7f591c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:39.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.432+0000 7f592e7fc6c0 1 -- 10.20.193.40:0/138129129 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f59300e3a70 con 0x7f594010b8d0 2026-02-13T01:25:39.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.432+0000 7f5944c646c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f591c0b56d0 0x7f591c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:39.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.432+0000 7f592e7fc6c0 1 -- 10.20.193.40:0/138129129 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f593011c5e0 con 0x7f594010b8d0 2026-02-13T01:25:39.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.433+0000 7f5944c646c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f591c0b56d0 0x7f591c0d5b80 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5940166a50 tx=0x7f5934009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:39.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.556+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f594010bca0 con 0x7f594010b8d0 2026-02-13T01:25:39.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.556+0000 7f592e7fc6c0 1 -- 10.20.193.40:0/138129129 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f59300a6410 con 0x7f594010b8d0 2026-02-13T01:25:39.558 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:39.558 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:39.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f591c0b56d0 msgr2=0x7f591c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f591c0b56d0 0x7f591c0d5b80 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5940166a50 tx=0x7f5934009310 comp rx=0 tx=0).stop 2026-02-13T01:25:39.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f594010b8d0 msgr2=0x7f59401600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f594010b8d0 0x7f59401600c0 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593000b710 tx=0x7f593000bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 shutdown_connections 2026-02-13T01:25:39.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f591c0b56d0 0x7f591c0d5b80 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.560 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5940155600 0x7f59401659c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.560 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f594010c1e0 0x7f5940160600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.560 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 --2- 10.20.193.40:0/138129129 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f594010b8d0 0x7f59401600c0 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.560 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 >> 10.20.193.40:0/138129129 conn(0x7f59400e9590 msgr2=0x7f5940109970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:39.560 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.557+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 shutdown_connections 2026-02-13T01:25:39.560 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:39.558+0000 7f59464676c0 1 -- 10.20.193.40:0/138129129 wait complete. 2026-02-13T01:25:39.619 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:39 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/138129129' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:39.892 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:39 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/138129129' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:40.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:39 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/138129129' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:40.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:40 trial055 ceph-mon[27509]: pgmap v233: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:25:40.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:40 trial040 ceph-mon[23046]: pgmap v233: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:25:41.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:40 trial118 ceph-mon[27812]: pgmap v233: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:25:42.661 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:42.846 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:42.887 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:42 trial040 ceph-mon[23046]: pgmap v234: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:25:42.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:42 trial055 ceph-mon[27509]: pgmap v234: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:25:43.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:42 trial118 ceph-mon[27812]: pgmap v234: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:25:43.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.050+0000 7f44f6a1b6c0 1 -- 10.20.193.40:0/4588017 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44f0115270 msgr2=0x7f44f0175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.050+0000 7f44f6a1b6c0 1 --2- 10.20.193.40:0/4588017 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44f0115270 0x7f44f0175c10 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=6120055764097261670 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44ec00aa70 tx=0x7f44ec02fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.050+0000 7f44f6a1b6c0 1 -- 10.20.193.40:0/4588017 shutdown_connections 2026-02-13T01:25:43.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.050+0000 7f44f6a1b6c0 1 --2- 10.20.193.40:0/4588017 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44f0115270 0x7f44f0175c10 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=6120055764097261670 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.050+0000 7f44f6a1b6c0 1 --2- 10.20.193.40:0/4588017 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f44f010fa50 0x7f44f0114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.050+0000 7f44f6a1b6c0 1 --2- 10.20.193.40:0/4588017 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f44f010f060 0x7f44f010f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.050+0000 7f44f6a1b6c0 1 -- 10.20.193.40:0/4588017 >> 10.20.193.40:0/4588017 conn(0x7f44f00ec980 msgr2=0x7f44f010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:43.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.050+0000 7f44f6a1b6c0 1 -- 10.20.193.40:0/4588017 shutdown_connections 2026-02-13T01:25:43.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.050+0000 7f44f6a1b6c0 1 -- 10.20.193.40:0/4588017 wait complete. 2026-02-13T01:25:43.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.051+0000 7f44f6a1b6c0 1 Processor -- start 2026-02-13T01:25:43.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.051+0000 7f44f6a1b6c0 1 -- start start 2026-02-13T01:25:43.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f6a1b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44f010f060 0x7f44f011cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f6a1b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f44f0115270 0x7f44f011d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f6a1b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f44f0122690 0x7f44f0122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f6a1b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44f01230a0 con 0x7f44f010f060 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f6a1b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0123210 con 0x7f44f0115270 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f6a1b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f44f01233d0 con 0x7f44f0122690 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f621a6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f44f0122690 0x7f44f0122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f5a196c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44f010f060 0x7f44f011cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f621a6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f44f0122690 0x7f44f0122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:46166/0 (socket says 10.20.193.40:46166) 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f621a6c0 1 -- 10.20.193.40:0/4178330265 learned_addr learned my addr 10.20.193.40:0/4178330265 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f52186c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f44f0115270 0x7f44f011d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f621a6c0 1 -- 10.20.193.40:0/4178330265 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f44f0115270 msgr2=0x7f44f011d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f621a6c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f44f0115270 0x7f44f011d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f621a6c0 1 -- 10.20.193.40:0/4178330265 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44f010f060 msgr2=0x7f44f011cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f621a6c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44f010f060 0x7f44f011cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f621a6c0 1 -- 10.20.193.40:0/4178330265 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ec00a660 con 0x7f44f0122690 2026-02-13T01:25:43.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.052+0000 7f44f621a6c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f44f0122690 0x7f44f0122b30 secure :-1 s=READY pgs=114 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44ec00ab70 tx=0x7f44ec032f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:43.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.053+0000 7f44deffd6c0 1 -- 10.20.193.40:0/4178330265 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44ec0055a0 con 0x7f44f0122690 2026-02-13T01:25:43.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.053+0000 7f44deffd6c0 1 -- 10.20.193.40:0/4178330265 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f44ec005700 con 0x7f44f0122690 2026-02-13T01:25:43.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.053+0000 7f44f6a1b6c0 1 -- 10.20.193.40:0/4178330265 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f0163820 con 0x7f44f0122690 2026-02-13T01:25:43.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.053+0000 7f44deffd6c0 1 -- 10.20.193.40:0/4178330265 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44ec0322b0 con 0x7f44f0122690 2026-02-13T01:25:43.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.053+0000 7f44f6a1b6c0 1 -- 10.20.193.40:0/4178330265 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f0163c50 con 0x7f44f0122690 2026-02-13T01:25:43.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.053+0000 7f44dcff96c0 1 -- 10.20.193.40:0/4178330265 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44bc005310 con 0x7f44f0122690 2026-02-13T01:25:43.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.055+0000 7f44deffd6c0 1 -- 10.20.193.40:0/4178330265 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f44ec003810 con 0x7f44f0122690 2026-02-13T01:25:43.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.057+0000 7f44deffd6c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44cc0b5650 0x7f44cc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.057+0000 7f44deffd6c0 1 -- 10.20.193.40:0/4178330265 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f44ec108e30 con 0x7f44f0122690 2026-02-13T01:25:43.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.057+0000 7f44f5a196c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44cc0b5650 0x7f44cc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.057+0000 7f44deffd6c0 1 -- 10.20.193.40:0/4178330265 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f44ec1092b0 con 0x7f44f0122690 2026-02-13T01:25:43.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.058+0000 7f44f5a196c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44cc0b5650 0x7f44cc0d5b00 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44e0004750 tx=0x7f44e0009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:43.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.182+0000 7f44dcff96c0 1 -- 10.20.193.40:0/4178330265 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f44bc005960 con 0x7f44f0122690 2026-02-13T01:25:43.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.182+0000 7f44deffd6c0 1 -- 10.20.193.40:0/4178330265 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f44ec0cb7d0 con 0x7f44f0122690 2026-02-13T01:25:43.184 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:43.184 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:43.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 -- 10.20.193.40:0/4178330265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44cc0b5650 msgr2=0x7f44cc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44cc0b5650 0x7f44cc0d5b00 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44e0004750 tx=0x7f44e0009390 comp rx=0 tx=0).stop 2026-02-13T01:25:43.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 -- 10.20.193.40:0/4178330265 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f44f0122690 msgr2=0x7f44f0122b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f44f0122690 0x7f44f0122b30 secure :-1 s=READY pgs=114 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44ec00ab70 tx=0x7f44ec032f60 comp rx=0 tx=0).stop 2026-02-13T01:25:43.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 -- 10.20.193.40:0/4178330265 shutdown_connections 2026-02-13T01:25:43.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44cc0b5650 0x7f44cc0d5b00 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f44f0122690 0x7f44f0122b30 unknown :-1 s=CLOSED pgs=114 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f44f0115270 0x7f44f011d2d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 --2- 10.20.193.40:0/4178330265 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44f010f060 0x7f44f011cd90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.183+0000 7f44dcff96c0 1 -- 10.20.193.40:0/4178330265 >> 10.20.193.40:0/4178330265 conn(0x7f44f00ec980 msgr2=0x7f44f010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:43.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.184+0000 7f44dcff96c0 1 -- 10.20.193.40:0/4178330265 shutdown_connections 2026-02-13T01:25:43.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:43.184+0000 7f44dcff96c0 1 -- 10.20.193.40:0/4178330265 wait complete. 2026-02-13T01:25:43.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:43 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4178330265' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:43.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:43 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4178330265' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:44.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:43 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4178330265' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:44.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:44 trial055 ceph-mon[27509]: pgmap v235: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:44.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:44 trial040 ceph-mon[23046]: pgmap v235: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:45.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:44 trial118 ceph-mon[27812]: pgmap v235: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:46.287 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:46.471 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:46.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.672+0000 7f79d679c6c0 1 -- 10.20.193.40:0/4037050614 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d010fa50 msgr2=0x7f79d0114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.672+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/4037050614 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d010fa50 0x7f79d0114a90 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=836905944965652557 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c40099a0 tx=0x7f79c402ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:46.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.672+0000 7f79d679c6c0 1 -- 10.20.193.40:0/4037050614 shutdown_connections 2026-02-13T01:25:46.674 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.672+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/4037050614 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79d0115270 0x7f79d0175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.672+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/4037050614 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d010fa50 0x7f79d0114a90 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=836905944965652557 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.672+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/4037050614 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79d010f060 0x7f79d010f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.672+0000 7f79d679c6c0 1 -- 10.20.193.40:0/4037050614 >> 10.20.193.40:0/4037050614 conn(0x7f79d00ec980 msgr2=0x7f79d010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:46.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.672+0000 7f79d679c6c0 1 -- 10.20.193.40:0/4037050614 shutdown_connections 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.673+0000 7f79d679c6c0 1 -- 10.20.193.40:0/4037050614 wait complete. 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d679c6c0 1 Processor -- start 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d679c6c0 1 -- start start 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d679c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79d010f060 0x7f79d00f49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d679c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d0115270 0x7f79d0175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d679c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79d00f5020 0x7f79d00fa2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d679c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f79d00f5710 con 0x7f79d0115270 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d679c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f79d00fa830 con 0x7f79d010f060 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d679c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79d00fa9f0 con 0x7f79d00f5020 2026-02-13T01:25:46.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d4f996c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d0115270 0x7f79d0175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d4f996c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d0115270 0x7f79d0175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:38254/0 (socket says 10.20.193.40:38254) 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d4f996c0 1 -- 10.20.193.40:0/3907221017 learned_addr learned my addr 10.20.193.40:0/3907221017 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d579a6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79d010f060 0x7f79d00f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.674+0000 7f79d5f9b6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79d00f5020 0x7f79d00fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d4f996c0 1 -- 10.20.193.40:0/3907221017 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79d00f5020 msgr2=0x7f79d00fa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d4f996c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79d00f5020 0x7f79d00fa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d4f996c0 1 -- 10.20.193.40:0/3907221017 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79d010f060 msgr2=0x7f79d00f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d4f996c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79d010f060 0x7f79d00f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d4f996c0 1 -- 10.20.193.40:0/3907221017 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c4009590 con 0x7f79d0115270 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d5f9b6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79d00f5020 0x7f79d00fa2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d4f996c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d0115270 0x7f79d0175b10 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c40092e0 tx=0x7f79c402f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:46.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79be7fc6c0 1 -- 10.20.193.40:0/3907221017 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79c40046b0 con 0x7f79d0115270 2026-02-13T01:25:46.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79be7fc6c0 1 -- 10.20.193.40:0/3907221017 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f79c4002be0 con 0x7f79d0115270 2026-02-13T01:25:46.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79be7fc6c0 1 -- 10.20.193.40:0/3907221017 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79c4007670 con 0x7f79d0115270 2026-02-13T01:25:46.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d00fac70 con 0x7f79d0115270 2026-02-13T01:25:46.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d00fb0a0 con 0x7f79d0115270 2026-02-13T01:25:46.679 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.675+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d0110330 con 0x7f79d0115270 2026-02-13T01:25:46.680 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.678+0000 7f79be7fc6c0 1 -- 10.20.193.40:0/3907221017 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f79c40026b0 con 0x7f79d0115270 2026-02-13T01:25:46.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.680+0000 7f79be7fc6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f79ac0b56d0 0x7f79ac0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:46.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.680+0000 7f79be7fc6c0 1 -- 10.20.193.40:0/3907221017 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f79c4107c80 con 0x7f79d0115270 2026-02-13T01:25:46.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.680+0000 7f79d579a6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f79ac0b56d0 0x7f79ac0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:46.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.680+0000 7f79be7fc6c0 1 -- 10.20.193.40:0/3907221017 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f79c4108170 con 0x7f79d0115270 2026-02-13T01:25:46.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.680+0000 7f79d579a6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f79ac0b56d0 0x7f79ac0d5b80 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c0005fd0 tx=0x7f79c0009590 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:46.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.804+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f79d010f430 con 0x7f79d0115270 2026-02-13T01:25:46.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.805+0000 7f79be7fc6c0 1 -- 10.20.193.40:0/3907221017 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f79c40ca660 con 0x7f79d0115270 2026-02-13T01:25:46.806 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:46.807 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:46.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f79ac0b56d0 msgr2=0x7f79ac0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f79ac0b56d0 0x7f79ac0d5b80 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c0005fd0 tx=0x7f79c0009590 comp rx=0 tx=0).stop 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d0115270 msgr2=0x7f79d0175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d0115270 0x7f79d0175b10 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c40092e0 tx=0x7f79c402f810 comp rx=0 tx=0).stop 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 shutdown_connections 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f79ac0b56d0 0x7f79ac0d5b80 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f79d00f5020 0x7f79d00fa2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f79d0115270 0x7f79d0175b10 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 --2- 10.20.193.40:0/3907221017 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79d010f060 0x7f79d00f49f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 >> 10.20.193.40:0/3907221017 conn(0x7f79d00ec980 msgr2=0x7f79d010d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:46.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 shutdown_connections 2026-02-13T01:25:46.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:46.806+0000 7f79d679c6c0 1 -- 10.20.193.40:0/3907221017 wait complete. 2026-02-13T01:25:46.851 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:46 trial040 ceph-mon[23046]: pgmap v236: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:46.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:46 trial055 ceph-mon[27509]: pgmap v236: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:47.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:46 trial118 ceph-mon[27812]: pgmap v236: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:47.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:47 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3907221017' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:47.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:47 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3907221017' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:48.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:47 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3907221017' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:48.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:48 trial055 ceph-mon[27509]: pgmap v237: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:48.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:48 trial040 ceph-mon[23046]: pgmap v237: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:49.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:48 trial118 ceph-mon[27812]: pgmap v237: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:25:49.911 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:50.096 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.281+0000 7f38992cf6c0 1 -- 10.20.193.40:0/2978113488 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f389410fa50 msgr2=0x7f3894114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.281+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/2978113488 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f389410fa50 0x7f3894114a90 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=1592146800682108350 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38840099a0 tx=0x7f388402ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:50.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.281+0000 7f38992cf6c0 1 -- 10.20.193.40:0/2978113488 shutdown_connections 2026-02-13T01:25:50.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.281+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/2978113488 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3894115270 0x7f3894175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.281+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/2978113488 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f389410fa50 0x7f3894114a90 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=1592146800682108350 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.281+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/2978113488 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f389410f060 0x7f389410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.281+0000 7f38992cf6c0 1 -- 10.20.193.40:0/2978113488 >> 10.20.193.40:0/2978113488 conn(0x7f38940ec980 msgr2=0x7f389410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.281+0000 7f38992cf6c0 1 -- 10.20.193.40:0/2978113488 shutdown_connections 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.281+0000 7f38992cf6c0 1 -- 10.20.193.40:0/2978113488 wait complete. 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.282+0000 7f38992cf6c0 1 Processor -- start 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.282+0000 7f38992cf6c0 1 -- start start 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.282+0000 7f38992cf6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f389410f060 0x7f38940f4810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.282+0000 7f38992cf6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3894115270 0x7f3894175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.282+0000 7f38992cf6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38940f4e40 0x7f38940fa0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.282+0000 7f38992cf6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f38940f5530 con 0x7f3894115270 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.282+0000 7f38992cf6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f38940fa600 con 0x7f38940f4e40 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.282+0000 7f38992cf6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f38940fa7c0 con 0x7f389410f060 2026-02-13T01:25:50.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f38937fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3894115270 0x7f3894175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3898ace6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38940f4e40 0x7f38940fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3893fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f389410f060 0x7f38940f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3898ace6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38940f4e40 0x7f38940fa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:52652/0 (socket says 10.20.193.40:52652) 2026-02-13T01:25:50.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3898ace6c0 1 -- 10.20.193.40:0/787693262 learned_addr learned my addr 10.20.193.40:0/787693262 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:50.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3898ace6c0 1 -- 10.20.193.40:0/787693262 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f389410f060 msgr2=0x7f38940f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3898ace6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f389410f060 0x7f38940f4810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3898ace6c0 1 -- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3894115270 msgr2=0x7f3894175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3898ace6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3894115270 0x7f3894175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3898ace6c0 1 -- 10.20.193.40:0/787693262 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3884009590 con 0x7f38940f4e40 2026-02-13T01:25:50.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f38937fe6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3894115270 0x7f3894175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:50.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f3898ace6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38940f4e40 0x7f38940fa0c0 secure :-1 s=READY pgs=107 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f388800c9b0 tx=0x7f388800ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f38917fa6c0 1 -- 10.20.193.40:0/787693262 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3888003c40 con 0x7f38940f4e40 2026-02-13T01:25:50.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f38917fa6c0 1 -- 10.20.193.40:0/787693262 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3888003da0 con 0x7f38940f4e40 2026-02-13T01:25:50.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38940faaa0 con 0x7f38940f4e40 2026-02-13T01:25:50.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f38917fa6c0 1 -- 10.20.193.40:0/787693262 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3888008440 con 0x7f38940f4e40 2026-02-13T01:25:50.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.283+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38940fb230 con 0x7f38940f4e40 2026-02-13T01:25:50.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.284+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3894110330 con 0x7f38940f4e40 2026-02-13T01:25:50.288 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.286+0000 7f38917fa6c0 1 -- 10.20.193.40:0/787693262 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f388800d6c0 con 0x7f38940f4e40 2026-02-13T01:25:50.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.288+0000 7f38917fa6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38680b56d0 0x7f38680d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.289 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.288+0000 7f38917fa6c0 1 -- 10.20.193.40:0/787693262 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f38880e4b40 con 0x7f38940f4e40 2026-02-13T01:25:50.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.288+0000 7f3893fff6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38680b56d0 0x7f38680d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.288+0000 7f38917fa6c0 1 -- 10.20.193.40:0/787693262 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f388811d5e0 con 0x7f38940f4e40 2026-02-13T01:25:50.290 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.289+0000 7f3893fff6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38680b56d0 0x7f38680d5b80 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3880004750 tx=0x7f3880009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.414+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f38940f5910 con 0x7f38940f4e40 2026-02-13T01:25:50.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.414+0000 7f38917fa6c0 1 -- 10.20.193.40:0/787693262 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f38880a74e0 con 0x7f38940f4e40 2026-02-13T01:25:50.416 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:50.416 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:50.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38680b56d0 msgr2=0x7f38680d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38680b56d0 0x7f38680d5b80 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3880004750 tx=0x7f3880009390 comp rx=0 tx=0).stop 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38940f4e40 msgr2=0x7f38940fa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38940f4e40 0x7f38940fa0c0 secure :-1 s=READY pgs=107 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f388800c9b0 tx=0x7f388800ce80 comp rx=0 tx=0).stop 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 shutdown_connections 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38680b56d0 0x7f38680d5b80 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38940f4e40 0x7f38940fa0c0 unknown :-1 s=CLOSED pgs=107 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3894115270 0x7f3894175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 --2- 10.20.193.40:0/787693262 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f389410f060 0x7f38940f4810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.415+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 >> 10.20.193.40:0/787693262 conn(0x7f38940ec980 msgr2=0x7f389410d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.416+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 shutdown_connections 2026-02-13T01:25:50.418 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:50.416+0000 7f38992cf6c0 1 -- 10.20.193.40:0/787693262 wait complete. 2026-02-13T01:25:50.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:50 trial040 ceph-mon[23046]: pgmap v238: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:25:50.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:50 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/787693262' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:50.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:50 trial055 ceph-mon[27509]: pgmap v238: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:25:50.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:50 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/787693262' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:51.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:50 trial118 ceph-mon[27812]: pgmap v238: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:25:51.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:50 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/787693262' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:52.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:52 trial055 ceph-mon[27509]: pgmap v239: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:25:52.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:52 trial040 ceph-mon[23046]: pgmap v239: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:25:53.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:52 trial118 ceph-mon[27812]: pgmap v239: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:25:53.557 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:53.740 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:53.872 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:53 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:53.875 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:53 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:53.879 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:53 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:53.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.937+0000 7fcd174376c0 1 -- 10.20.193.40:0/1031356892 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010c1e0 msgr2=0x7fcd101550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.937+0000 7fcd174376c0 1 --2- 10.20.193.40:0/1031356892 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010c1e0 0x7fcd101550c0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=14117215818371339066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd04009970 tx=0x7fcd0402ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:53.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.937+0000 7fcd174376c0 1 -- 10.20.193.40:0/1031356892 shutdown_connections 2026-02-13T01:25:53.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.937+0000 7fcd174376c0 1 --2- 10.20.193.40:0/1031356892 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcd10155600 0x7fcd101759e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.937+0000 7fcd174376c0 1 --2- 10.20.193.40:0/1031356892 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010c1e0 0x7fcd101550c0 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=14117215818371339066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.937+0000 7fcd174376c0 1 --2- 10.20.193.40:0/1031356892 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcd1010b8d0 0x7fcd1010bca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.937+0000 7fcd174376c0 1 -- 10.20.193.40:0/1031356892 >> 10.20.193.40:0/1031356892 conn(0x7fcd100e9590 msgr2=0x7fcd101099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:53.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.937+0000 7fcd174376c0 1 -- 10.20.193.40:0/1031356892 shutdown_connections 2026-02-13T01:25:53.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.937+0000 7fcd174376c0 1 -- 10.20.193.40:0/1031356892 wait complete. 2026-02-13T01:25:53.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.938+0000 7fcd174376c0 1 Processor -- start 2026-02-13T01:25:53.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.938+0000 7fcd174376c0 1 -- start start 2026-02-13T01:25:53.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.938+0000 7fcd174376c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010b8d0 0x7fcd10160170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.938+0000 7fcd174376c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcd1010c1e0 0x7fcd101606b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.938+0000 7fcd174376c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcd10155600 0x7fcd10165a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.938+0000 7fcd174376c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101660c0 con 0x7fcd1010b8d0 2026-02-13T01:25:53.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.938+0000 7fcd174376c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10166230 con 0x7fcd10155600 2026-02-13T01:25:53.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.938+0000 7fcd174376c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101663f0 con 0x7fcd1010c1e0 2026-02-13T01:25:53.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd164356c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010b8d0 0x7fcd10160170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd164356c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010b8d0 0x7fcd10160170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60896/0 (socket says 10.20.193.40:60896) 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd164356c0 1 -- 10.20.193.40:0/2885462663 learned_addr learned my addr 10.20.193.40:0/2885462663 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd15c346c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcd1010c1e0 0x7fcd101606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd16c366c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcd10155600 0x7fcd10165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd164356c0 1 -- 10.20.193.40:0/2885462663 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcd1010c1e0 msgr2=0x7fcd101606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd164356c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcd1010c1e0 0x7fcd101606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd164356c0 1 -- 10.20.193.40:0/2885462663 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcd10155600 msgr2=0x7fcd10165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd164356c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcd10155600 0x7fcd10165a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd164356c0 1 -- 10.20.193.40:0/2885462663 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd04009590 con 0x7fcd1010b8d0 2026-02-13T01:25:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.939+0000 7fcd164356c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010b8d0 0x7fcd10160170 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd0000b710 tx=0x7fcd0000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:53.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.940+0000 7fccf77fe6c0 1 -- 10.20.193.40:0/2885462663 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd00004250 con 0x7fcd1010b8d0 2026-02-13T01:25:53.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.940+0000 7fccf77fe6c0 1 -- 10.20.193.40:0/2885462663 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fcd00009070 con 0x7fcd1010b8d0 2026-02-13T01:25:53.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.940+0000 7fccf77fe6c0 1 -- 10.20.193.40:0/2885462663 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd000071c0 con 0x7fcd1010b8d0 2026-02-13T01:25:53.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.940+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd101666d0 con 0x7fcd1010b8d0 2026-02-13T01:25:53.944 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.940+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd10152240 con 0x7fcd1010b8d0 2026-02-13T01:25:53.944 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.940+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd101668f0 con 0x7fcd1010b8d0 2026-02-13T01:25:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.942+0000 7fccf77fe6c0 1 -- 10.20.193.40:0/2885462663 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fcd000043b0 con 0x7fcd1010b8d0 2026-02-13T01:25:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.944+0000 7fccf77fe6c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fccec0b57a0 0x7fccec0d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.944+0000 7fccf77fe6c0 1 -- 10.20.193.40:0/2885462663 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fcd000e3b20 con 0x7fcd1010b8d0 2026-02-13T01:25:53.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.944+0000 7fcd15c346c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fccec0b57a0 0x7fccec0d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.944+0000 7fccf77fe6c0 1 -- 10.20.193.40:0/2885462663 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcd0011c5e0 con 0x7fcd1010b8d0 2026-02-13T01:25:53.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:53.945+0000 7fcd15c346c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fccec0b57a0 0x7fccec0d5c50 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd040023e0 tx=0x7fcd04005c60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:54.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.072+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcd101612c0 con 0x7fcd1010b8d0 2026-02-13T01:25:54.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.072+0000 7fccf77fe6c0 1 -- 10.20.193.40:0/2885462663 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fcd000a65f0 con 0x7fcd1010b8d0 2026-02-13T01:25:54.074 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:54.074 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:54.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fccec0b57a0 msgr2=0x7fccec0d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fccec0b57a0 0x7fccec0d5c50 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd040023e0 tx=0x7fcd04005c60 comp rx=0 tx=0).stop 2026-02-13T01:25:54.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010b8d0 msgr2=0x7fcd10160170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.075 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010b8d0 0x7fcd10160170 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd0000b710 tx=0x7fcd0000bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 shutdown_connections 2026-02-13T01:25:54.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fccec0b57a0 0x7fccec0d5c50 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fcd10155600 0x7fcd10165a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fcd1010c1e0 0x7fcd101606b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 --2- 10.20.193.40:0/2885462663 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcd1010b8d0 0x7fcd10160170 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 >> 10.20.193.40:0/2885462663 conn(0x7fcd100e9590 msgr2=0x7fcd10109970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:54.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 shutdown_connections 2026-02-13T01:25:54.076 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:54.074+0000 7fcd174376c0 1 -- 10.20.193.40:0/2885462663 wait complete. 2026-02-13T01:25:54.607 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:54 trial055 ceph-mon[27509]: pgmap v240: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:54.607 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:54 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2885462663' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:54.607 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:54 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:54.607 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:54 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:54.607 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:54 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:54.607 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:54 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:54 trial040 ceph-mon[23046]: pgmap v240: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:54 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2885462663' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:54 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:54 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:54 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:54.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:54 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:55.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:54 trial118 ceph-mon[27812]: pgmap v240: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:25:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:54 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2885462663' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:54 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:54 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:54 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:55.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:54 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.067 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.067 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.067 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:56.067 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:56.067 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.067 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:56.067 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:56.067 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:55 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:56.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:56.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:55 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:25:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:56.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:55 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:57.187 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:57.238 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:56 trial040 ceph-mon[23046]: pgmap v241: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:57.238 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:56 trial040 ceph-mon[23046]: pgmap v242: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:25:57.239 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:56 trial040 ceph-mon[23046]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:57.239 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:56 trial040 ceph-mon[23046]: Cluster is now healthy 2026-02-13T01:25:57.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:56 trial055 ceph-mon[27509]: pgmap v241: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:57.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:56 trial055 ceph-mon[27509]: pgmap v242: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:25:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:56 trial055 ceph-mon[27509]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:57.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:56 trial055 ceph-mon[27509]: Cluster is now healthy 2026-02-13T01:25:57.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:56 trial118 ceph-mon[27812]: pgmap v241: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:25:57.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:56 trial118 ceph-mon[27812]: pgmap v242: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:25:57.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:56 trial118 ceph-mon[27812]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:57.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:56 trial118 ceph-mon[27812]: Cluster is now healthy 2026-02-13T01:25:57.372 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:25:57.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.570+0000 7fbf249476c0 1 -- 10.20.193.40:0/3079461151 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10fbf0 msgr2=0x7fbf1c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:57.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.570+0000 7fbf249476c0 1 --2- 10.20.193.40:0/3079461151 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10fbf0 0x7fbf1c114c30 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=15893238153431931373 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf080098d0 tx=0x7fbf0802ec30 comp rx=0 tx=0).stop 2026-02-13T01:25:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.570+0000 7fbf249476c0 1 -- 10.20.193.40:0/3079461151 shutdown_connections 2026-02-13T01:25:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.570+0000 7fbf249476c0 1 --2- 10.20.193.40:0/3079461151 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf1c115410 0x7fbf1c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.570+0000 7fbf249476c0 1 --2- 10.20.193.40:0/3079461151 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10fbf0 0x7fbf1c114c30 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=15893238153431931373 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.570+0000 7fbf249476c0 1 --2- 10.20.193.40:0/3079461151 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf1c10f200 0x7fbf1c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.570+0000 7fbf249476c0 1 -- 10.20.193.40:0/3079461151 >> 10.20.193.40:0/3079461151 conn(0x7fbf1c0ecb00 msgr2=0x7fbf1c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.570+0000 7fbf249476c0 1 -- 10.20.193.40:0/3079461151 shutdown_connections 2026-02-13T01:25:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.570+0000 7fbf249476c0 1 -- 10.20.193.40:0/3079461151 wait complete. 2026-02-13T01:25:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.571+0000 7fbf249476c0 1 Processor -- start 2026-02-13T01:25:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.571+0000 7fbf249476c0 1 -- start start 2026-02-13T01:25:57.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.571+0000 7fbf249476c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10f200 0x7fbf1c0f4990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:57.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.571+0000 7fbf249476c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf1c115410 0x7fbf1c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:57.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.571+0000 7fbf249476c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf1c0f4fc0 0x7fbf1c0fa240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:57.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.571+0000 7fbf249476c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0f56b0 con 0x7fbf1c10f200 2026-02-13T01:25:57.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.571+0000 7fbf249476c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0fa780 con 0x7fbf1c115410 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.571+0000 7fbf249476c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0fa940 con 0x7fbf1c0f4fc0 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.571+0000 7fbf226b86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10f200 0x7fbf1c0f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf226b86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10f200 0x7fbf1c0f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60914/0 (socket says 10.20.193.40:60914) 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf226b86c0 1 -- 10.20.193.40:0/1406195776 learned_addr learned my addr 10.20.193.40:0/1406195776 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf21eb76c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf1c115410 0x7fbf1c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf22eb96c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf1c0f4fc0 0x7fbf1c0fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf226b86c0 1 -- 10.20.193.40:0/1406195776 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf1c0f4fc0 msgr2=0x7fbf1c0fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf226b86c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf1c0f4fc0 0x7fbf1c0fa240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf226b86c0 1 -- 10.20.193.40:0/1406195776 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf1c115410 msgr2=0x7fbf1c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf226b86c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf1c115410 0x7fbf1c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf226b86c0 1 -- 10.20.193.40:0/1406195776 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf080094c0 con 0x7fbf1c10f200 2026-02-13T01:25:57.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf226b86c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10f200 0x7fbf1c0f4990 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1400b800 tx=0x7fbf1400bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:57.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf077fe6c0 1 -- 10.20.193.40:0/1406195776 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf14004a80 con 0x7fbf1c10f200 2026-02-13T01:25:57.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf077fe6c0 1 -- 10.20.193.40:0/1406195776 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbf14009030 con 0x7fbf1c10f200 2026-02-13T01:25:57.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf077fe6c0 1 -- 10.20.193.40:0/1406195776 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf14007440 con 0x7fbf1c10f200 2026-02-13T01:25:57.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf249476c0 1 -- 10.20.193.40:0/1406195776 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1c0fac20 con 0x7fbf1c10f200 2026-02-13T01:25:57.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.572+0000 7fbf249476c0 1 -- 10.20.193.40:0/1406195776 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1c0fb3b0 con 0x7fbf1c10f200 2026-02-13T01:25:57.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.573+0000 7fbf057fa6c0 1 -- 10.20.193.40:0/1406195776 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf1c1104d0 con 0x7fbf1c10f200 2026-02-13T01:25:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.575+0000 7fbf077fe6c0 1 -- 10.20.193.40:0/1406195776 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fbf14004be0 con 0x7fbf1c10f200 2026-02-13T01:25:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.576+0000 7fbf077fe6c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbef80b56d0 0x7fbef80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.577+0000 7fbf077fe6c0 1 -- 10.20.193.40:0/1406195776 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fbf140e3b60 con 0x7fbf1c10f200 2026-02-13T01:25:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.577+0000 7fbf077fe6c0 1 -- 10.20.193.40:0/1406195776 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbf1411c5e0 con 0x7fbf1c10f200 2026-02-13T01:25:57.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.577+0000 7fbf21eb76c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbef80b56d0 0x7fbef80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:57.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.577+0000 7fbf21eb76c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbef80b56d0 0x7fbef80d5b80 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1c0fb2d0 tx=0x7fbf080023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:57.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.702+0000 7fbf057fa6c0 1 -- 10.20.193.40:0/1406195776 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbf1c0f5a90 con 0x7fbf1c10f200 2026-02-13T01:25:57.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.703+0000 7fbf077fe6c0 1 -- 10.20.193.40:0/1406195776 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbf140a6500 con 0x7fbf1c10f200 2026-02-13T01:25:57.704 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:25:57.704 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:57.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 -- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbef80b56d0 msgr2=0x7fbef80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:57.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbef80b56d0 0x7fbef80d5b80 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1c0fb2d0 tx=0x7fbf080023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 -- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10f200 msgr2=0x7fbf1c0f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10f200 0x7fbf1c0f4990 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1400b800 tx=0x7fbf1400bcd0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 -- 10.20.193.40:0/1406195776 shutdown_connections 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbef80b56d0 0x7fbef80d5b80 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf1c0f4fc0 0x7fbf1c0fa240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf1c115410 0x7fbf1c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 --2- 10.20.193.40:0/1406195776 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf1c10f200 0x7fbf1c0f4990 unknown :-1 s=CLOSED pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 -- 10.20.193.40:0/1406195776 >> 10.20.193.40:0/1406195776 conn(0x7fbf1c0ecb00 msgr2=0x7fbf1c10d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 -- 10.20.193.40:0/1406195776 shutdown_connections 2026-02-13T01:25:57.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:25:57.704+0000 7fbf057fa6c0 1 -- 10.20.193.40:0/1406195776 wait complete. 2026-02-13T01:25:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:57 trial055 ceph-mon[27509]: pgmap v243: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:25:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:57 trial055 ceph-mon[27509]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:57 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1406195776' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:57 trial040 ceph-mon[23046]: pgmap v243: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:25:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:57 trial040 ceph-mon[23046]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:57 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1406195776' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:58.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:57 trial118 ceph-mon[27812]: pgmap v243: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:25:58.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:57 trial118 ceph-mon[27812]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:58.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:57 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1406195776' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:00.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:25:59 trial055 ceph-mon[27509]: pgmap v244: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:00.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:25:59 trial040 ceph-mon[23046]: pgmap v244: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:00.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:25:59 trial118 ceph-mon[27812]: pgmap v244: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:00.811 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:00.999 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:01.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.182+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3394241872 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe47810fa50 msgr2=0x7fe478114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:01.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.182+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3394241872 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe47810fa50 0x7fe478114a90 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=2077397577189533407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4680099a0 tx=0x7fe46802ed50 comp rx=0 tx=0).stop 2026-02-13T01:26:01.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.182+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3394241872 shutdown_connections 2026-02-13T01:26:01.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.182+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3394241872 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe478115270 0x7fe478175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.182+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3394241872 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe47810fa50 0x7fe478114a90 unknown :-1 s=CLOSED pgs=295 gs=1 cs=0 l=1 c_cookie=2077397577189533407 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.182+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3394241872 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe47810f060 0x7fe47810f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.182+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3394241872 >> 10.20.193.40:0/3394241872 conn(0x7fe4780ec980 msgr2=0x7fe47810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:01.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.182+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3394241872 shutdown_connections 2026-02-13T01:26:01.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.182+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3394241872 wait complete. 2026-02-13T01:26:01.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe47d3c06c0 1 Processor -- start 2026-02-13T01:26:01.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe47d3c06c0 1 -- start start 2026-02-13T01:26:01.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe47d3c06c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe47810f060 0x7fe4780f49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:01.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe47d3c06c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe478115270 0x7fe478175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:01.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe47d3c06c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe4780f5020 0x7fe4780fa2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:01.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe47d3c06c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780f5710 con 0x7fe47810f060 2026-02-13T01:26:01.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe47d3c06c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780fa830 con 0x7fe4780f5020 2026-02-13T01:26:01.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe47d3c06c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780fa9f0 con 0x7fe478115270 2026-02-13T01:26:01.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe477fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe47810f060 0x7fe4780f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:01.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe4777fe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe478115270 0x7fe478175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:01.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe4777fe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe478115270 0x7fe478175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:33144/0 (socket says 10.20.193.40:33144) 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe4777fe6c0 1 -- 10.20.193.40:0/3794175822 learned_addr learned my addr 10.20.193.40:0/3794175822 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.183+0000 7fe47cbbf6c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe4780f5020 0x7fe4780fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe4777fe6c0 1 -- 10.20.193.40:0/3794175822 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe4780f5020 msgr2=0x7fe4780fa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe4777fe6c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe4780f5020 0x7fe4780fa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe4777fe6c0 1 -- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe47810f060 msgr2=0x7fe4780f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe4777fe6c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe47810f060 0x7fe4780f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe4777fe6c0 1 -- 10.20.193.40:0/3794175822 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe468009590 con 0x7fe478115270 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe477fff6c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe47810f060 0x7fe4780f49f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe47cbbf6c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe4780f5020 0x7fe4780fa2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe4777fe6c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe478115270 0x7fe478175b10 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe468009290 tx=0x7fe46802f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:01.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe4757fa6c0 1 -- 10.20.193.40:0/3794175822 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4680046b0 con 0x7fe478115270 2026-02-13T01:26:01.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe4757fa6c0 1 -- 10.20.193.40:0/3794175822 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe468002be0 con 0x7fe478115270 2026-02-13T01:26:01.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4780fac70 con 0x7fe478115270 2026-02-13T01:26:01.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe4757fa6c0 1 -- 10.20.193.40:0/3794175822 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe468007670 con 0x7fe478115270 2026-02-13T01:26:01.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.184+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4780fb0f0 con 0x7fe478115270 2026-02-13T01:26:01.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.185+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe478110330 con 0x7fe478115270 2026-02-13T01:26:01.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.187+0000 7fe4757fa6c0 1 -- 10.20.193.40:0/3794175822 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe4680026b0 con 0x7fe478115270 2026-02-13T01:26:01.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.188+0000 7fe4757fa6c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe44c0b5650 0x7fe44c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:01.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.189+0000 7fe477fff6c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe44c0b5650 0x7fe44c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:01.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.189+0000 7fe4757fa6c0 1 -- 10.20.193.40:0/3794175822 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fe468107cc0 con 0x7fe478115270 2026-02-13T01:26:01.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.189+0000 7fe4757fa6c0 1 -- 10.20.193.40:0/3794175822 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe468108140 con 0x7fe478115270 2026-02-13T01:26:01.191 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.189+0000 7fe477fff6c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe44c0b5650 0x7fe44c0d5b00 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe464005fd0 tx=0x7fe4640093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:01.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.313+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe47810f430 con 0x7fe478115270 2026-02-13T01:26:01.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.313+0000 7fe4757fa6c0 1 -- 10.20.193.40:0/3794175822 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe4680ca660 con 0x7fe478115270 2026-02-13T01:26:01.315 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:01.315 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe44c0b5650 msgr2=0x7fe44c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe44c0b5650 0x7fe44c0d5b00 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe464005fd0 tx=0x7fe4640093f0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe478115270 msgr2=0x7fe478175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe478115270 0x7fe478175b10 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe468009290 tx=0x7fe46802f820 comp rx=0 tx=0).stop 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 shutdown_connections 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe44c0b5650 0x7fe44c0d5b00 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe4780f5020 0x7fe4780fa2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe478115270 0x7fe478175b10 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 --2- 10.20.193.40:0/3794175822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe47810f060 0x7fe4780f49f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:01.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 >> 10.20.193.40:0/3794175822 conn(0x7fe4780ec980 msgr2=0x7fe47810d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:01.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 shutdown_connections 2026-02-13T01:26:01.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:01.314+0000 7fe47d3c06c0 1 -- 10.20.193.40:0/3794175822 wait complete. 2026-02-13T01:26:02.056 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:01 trial118 ceph-mon[27812]: pgmap v245: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:02.056 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:01 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3794175822' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:02.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:01 trial055 ceph-mon[27509]: pgmap v245: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:02.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:01 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3794175822' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:02.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:01 trial040 ceph-mon[23046]: pgmap v245: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:02.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:01 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3794175822' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:04.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:03 trial055 ceph-mon[27509]: pgmap v246: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-13T01:26:04.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:03 trial040 ceph-mon[23046]: pgmap v246: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-13T01:26:04.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:03 trial118 ceph-mon[27812]: pgmap v246: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-13T01:26:04.422 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:04.609 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:04.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.794+0000 7fda8c9276c0 1 -- 10.20.193.40:0/652991477 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda84114190 msgr2=0x7fda84119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.794+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/652991477 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda84114190 0x7fda84119140 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=16956250068124367036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda70009970 tx=0x7fda7002ed10 comp rx=0 tx=0).stop 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.794+0000 7fda8c9276c0 1 -- 10.20.193.40:0/652991477 shutdown_connections 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.794+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/652991477 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda841198f0 0x7fda8417a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.794+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/652991477 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda84114190 0x7fda84119140 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=16956250068124367036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.794+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/652991477 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda841137a0 0x7fda84113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.794+0000 7fda8c9276c0 1 -- 10.20.193.40:0/652991477 >> 10.20.193.40:0/652991477 conn(0x7fda84060760 msgr2=0x7fda84060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.794+0000 7fda8c9276c0 1 -- 10.20.193.40:0/652991477 shutdown_connections 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.794+0000 7fda8c9276c0 1 -- 10.20.193.40:0/652991477 wait complete. 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8c9276c0 1 Processor -- start 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8c9276c0 1 -- start start 2026-02-13T01:26:04.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8c9276c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda841137a0 0x7fda841214b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8c9276c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda841198f0 0x7fda841219f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8c9276c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda84126db0 0x7fda84127250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8c9276c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fda841277c0 con 0x7fda841137a0 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8c9276c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fda84127930 con 0x7fda841198f0 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8c9276c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fda84127af0 con 0x7fda84126db0 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8a6986c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda841137a0 0x7fda841214b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8a6986c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda841137a0 0x7fda841214b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:52258/0 (socket says 10.20.193.40:52258) 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8a6986c0 1 -- 10.20.193.40:0/1221376458 learned_addr learned my addr 10.20.193.40:0/1221376458 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda89e976c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda841198f0 0x7fda841219f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8ae996c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda84126db0 0x7fda84127250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:04.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8a6986c0 1 -- 10.20.193.40:0/1221376458 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda84126db0 msgr2=0x7fda84127250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8a6986c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda84126db0 0x7fda84127250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8a6986c0 1 -- 10.20.193.40:0/1221376458 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda841198f0 msgr2=0x7fda841219f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8a6986c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda841198f0 0x7fda841219f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8a6986c0 1 -- 10.20.193.40:0/1221376458 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda70009590 con 0x7fda841137a0 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.795+0000 7fda8ae996c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda84126db0 0x7fda84127250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.796+0000 7fda8a6986c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda841137a0 0x7fda841214b0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda7c009490 tx=0x7fda7c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.796+0000 7fda6f7fe6c0 1 -- 10.20.193.40:0/1221376458 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda7c004a80 con 0x7fda841137a0 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.796+0000 7fda6f7fe6c0 1 -- 10.20.193.40:0/1221376458 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fda7c009030 con 0x7fda841137a0 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.796+0000 7fda6f7fe6c0 1 -- 10.20.193.40:0/1221376458 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda7c0071c0 con 0x7fda841137a0 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.796+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda84167fa0 con 0x7fda841137a0 2026-02-13T01:26:04.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.796+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda84168430 con 0x7fda841137a0 2026-02-13T01:26:04.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.796+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4c005310 con 0x7fda841137a0 2026-02-13T01:26:04.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.799+0000 7fda6f7fe6c0 1 -- 10.20.193.40:0/1221376458 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fda7c004e50 con 0x7fda841137a0 2026-02-13T01:26:04.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.800+0000 7fda6f7fe6c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda600b56d0 0x7fda600d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:04.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.800+0000 7fda6f7fe6c0 1 -- 10.20.193.40:0/1221376458 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fda7c0e3c10 con 0x7fda841137a0 2026-02-13T01:26:04.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.800+0000 7fda89e976c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda600b56d0 0x7fda600d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:04.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.800+0000 7fda6f7fe6c0 1 -- 10.20.193.40:0/1221376458 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fda7c0e4090 con 0x7fda841137a0 2026-02-13T01:26:04.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.801+0000 7fda89e976c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda600b56d0 0x7fda600d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda84127e40 tx=0x7fda700023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:04.926 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.924+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fda4c005960 con 0x7fda841137a0 2026-02-13T01:26:04.926 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.924+0000 7fda6f7fe6c0 1 -- 10.20.193.40:0/1221376458 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fda7c0a65b0 con 0x7fda841137a0 2026-02-13T01:26:04.926 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:04.926 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:04.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.925+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda600b56d0 msgr2=0x7fda600d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:04.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.925+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda600b56d0 0x7fda600d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda84127e40 tx=0x7fda700023a0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.925+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda841137a0 msgr2=0x7fda841214b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.925+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda841137a0 0x7fda841214b0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda7c009490 tx=0x7fda7c00bca0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.926+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 shutdown_connections 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.926+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fda600b56d0 0x7fda600d5b80 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.926+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fda84126db0 0x7fda84127250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.926+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fda841198f0 0x7fda841219f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.926+0000 7fda8c9276c0 1 --2- 10.20.193.40:0/1221376458 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fda841137a0 0x7fda841214b0 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.926+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 >> 10.20.193.40:0/1221376458 conn(0x7fda84060760 msgr2=0x7fda84117740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.926+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 shutdown_connections 2026-02-13T01:26:04.928 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:04.926+0000 7fda8c9276c0 1 -- 10.20.193.40:0/1221376458 wait complete. 2026-02-13T01:26:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:05 trial055 ceph-mon[27509]: pgmap v247: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:06.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:05 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1221376458' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:05 trial040 ceph-mon[23046]: pgmap v247: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:06.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:05 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1221376458' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:06.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:05 trial118 ceph-mon[27812]: pgmap v247: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:06.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:05 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1221376458' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:08.030 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:08.084 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:07 trial040 ceph-mon[23046]: pgmap v248: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:26:08.218 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:08.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:07 trial055 ceph-mon[27509]: pgmap v248: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:26:08.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:07 trial118 ceph-mon[27812]: pgmap v248: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:26:08.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.407+0000 7f1b289af6c0 1 -- 10.20.193.40:0/1856246589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b2410fa50 msgr2=0x7f1b24114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:08.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.407+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/1856246589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b2410fa50 0x7f1b24114a90 secure :-1 s=READY pgs=298 gs=3 cs=0 l=1 c_cookie=8732872421344943693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b140098d0 tx=0x7f1b1402ec30 comp rx=0 tx=0).stop 2026-02-13T01:26:08.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.407+0000 7f1b289af6c0 1 -- 10.20.193.40:0/1856246589 shutdown_connections 2026-02-13T01:26:08.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.407+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/1856246589 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1b24115270 0x7f1b24175c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:08.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.407+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/1856246589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b2410fa50 0x7f1b24114a90 unknown :-1 s=CLOSED pgs=298 gs=3 cs=0 l=1 c_cookie=8732872421344943693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:08.409 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.407+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/1856246589 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1b2410f060 0x7f1b2410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:08.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.407+0000 7f1b289af6c0 1 -- 10.20.193.40:0/1856246589 >> 10.20.193.40:0/1856246589 conn(0x7f1b240ec980 msgr2=0x7f1b2410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:08.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.407+0000 7f1b289af6c0 1 -- 10.20.193.40:0/1856246589 shutdown_connections 2026-02-13T01:26:08.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.407+0000 7f1b289af6c0 1 -- 10.20.193.40:0/1856246589 wait complete. 2026-02-13T01:26:08.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b289af6c0 1 Processor -- start 2026-02-13T01:26:08.410 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b289af6c0 1 -- start start 2026-02-13T01:26:08.411 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b289af6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1b2410f060 0x7f1b240f49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b289af6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1b24115270 0x7f1b24175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b289af6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b240f5020 0x7f1b240fa2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b289af6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1b240f5710 con 0x7f1b240f5020 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b289af6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1b240fa830 con 0x7f1b2410f060 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b289af6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1b240fa9f0 con 0x7f1b24115270 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b237fe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1b2410f060 0x7f1b240f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b23fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b240f5020 0x7f1b240fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b237fe6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1b2410f060 0x7f1b240f49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:33958/0 (socket says 10.20.193.40:33958) 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b237fe6c0 1 -- 10.20.193.40:0/952550258 learned_addr learned my addr 10.20.193.40:0/952550258 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:08.412 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b23fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b240f5020 0x7f1b240fa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:52276/0 (socket says 10.20.193.40:52276) 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b22ffd6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1b24115270 0x7f1b24175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b23fff6c0 1 -- 10.20.193.40:0/952550258 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1b24115270 msgr2=0x7f1b24175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b23fff6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1b24115270 0x7f1b24175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b23fff6c0 1 -- 10.20.193.40:0/952550258 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1b2410f060 msgr2=0x7f1b240f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b23fff6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1b2410f060 0x7f1b240f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.408+0000 7f1b23fff6c0 1 -- 10.20.193.40:0/952550258 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b140094c0 con 0x7f1b240f5020 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.409+0000 7f1b23fff6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b240f5020 0x7f1b240fa2f0 secure :-1 s=READY pgs=299 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b18006f60 tx=0x7f1b1800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.409+0000 7f1b20ff96c0 1 -- 10.20.193.40:0/952550258 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b18003c40 con 0x7f1b240f5020 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.409+0000 7f1b20ff96c0 1 -- 10.20.193.40:0/952550258 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1b18003da0 con 0x7f1b240f5020 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.409+0000 7f1b20ff96c0 1 -- 10.20.193.40:0/952550258 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b180081c0 con 0x7f1b240f5020 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.409+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b240facd0 con 0x7f1b240f5020 2026-02-13T01:26:08.413 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.409+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b240fb0d0 con 0x7f1b240f5020 2026-02-13T01:26:08.414 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.409+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b24110330 con 0x7f1b240f5020 2026-02-13T01:26:08.414 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.411+0000 7f1b20ff96c0 1 -- 10.20.193.40:0/952550258 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1b1800d5f0 con 0x7f1b240f5020 2026-02-13T01:26:08.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.413+0000 7f1b20ff96c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1af80b5650 0x7f1af80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:08.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.413+0000 7f1b20ff96c0 1 -- 10.20.193.40:0/952550258 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f1b180e4b80 con 0x7f1b240f5020 2026-02-13T01:26:08.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.413+0000 7f1b237fe6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1af80b5650 0x7f1af80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:08.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.413+0000 7f1b20ff96c0 1 -- 10.20.193.40:0/952550258 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1b1811d5e0 con 0x7f1b240f5020 2026-02-13T01:26:08.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.414+0000 7f1b237fe6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1af80b5650 0x7f1af80d5b00 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b10009260 tx=0x7f1b10009440 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:08.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.540+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1b2410fa50 con 0x7f1b240f5020 2026-02-13T01:26:08.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.540+0000 7f1b20ff96c0 1 -- 10.20.193.40:0/952550258 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1b180a7520 con 0x7f1b240f5020 2026-02-13T01:26:08.542 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:08.542 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1af80b5650 msgr2=0x7f1af80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1af80b5650 0x7f1af80d5b00 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b10009260 tx=0x7f1b10009440 comp rx=0 tx=0).stop 2026-02-13T01:26:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b240f5020 msgr2=0x7f1b240fa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b240f5020 0x7f1b240fa2f0 secure :-1 s=READY pgs=299 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b18006f60 tx=0x7f1b1800cc00 comp rx=0 tx=0).stop 2026-02-13T01:26:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 shutdown_connections 2026-02-13T01:26:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1af80b5650 0x7f1af80d5b00 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1b240f5020 0x7f1b240fa2f0 unknown :-1 s=CLOSED pgs=299 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1b24115270 0x7f1b24175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:08.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 --2- 10.20.193.40:0/952550258 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1b2410f060 0x7f1b240f49f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:08.544 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 >> 10.20.193.40:0/952550258 conn(0x7f1b240ec980 msgr2=0x7f1b2410d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:08.544 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 shutdown_connections 2026-02-13T01:26:08.544 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:08.541+0000 7f1b289af6c0 1 -- 10.20.193.40:0/952550258 wait complete. 2026-02-13T01:26:08.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:08 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/952550258' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:09.142 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:08 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/952550258' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:09.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:08 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/952550258' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:10.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:09 trial055 ceph-mon[27509]: pgmap v249: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:10.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:09 trial040 ceph-mon[23046]: pgmap v249: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:10.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:09 trial118 ceph-mon[27812]: pgmap v249: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:11.645 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:11.831 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:11.948 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:11 trial040 ceph-mon[23046]: pgmap v250: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:12.042 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.040+0000 7f30502316c0 1 -- 10.20.193.40:0/597717954 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3048115410 msgr2=0x7f3048175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.042 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.040+0000 7f30502316c0 1 --2- 10.20.193.40:0/597717954 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3048115410 0x7f3048175db0 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=4792021580846522226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f304400aa70 tx=0x7f304402fdd0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.042 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.040+0000 7f30502316c0 1 -- 10.20.193.40:0/597717954 shutdown_connections 2026-02-13T01:26:12.042 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.040+0000 7f30502316c0 1 --2- 10.20.193.40:0/597717954 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3048115410 0x7f3048175db0 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=4792021580846522226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.042 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.040+0000 7f30502316c0 1 --2- 10.20.193.40:0/597717954 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f304810fbf0 0x7f3048114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.042 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.040+0000 7f30502316c0 1 --2- 10.20.193.40:0/597717954 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f304810f200 0x7f304810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.043 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.040+0000 7f30502316c0 1 -- 10.20.193.40:0/597717954 >> 10.20.193.40:0/597717954 conn(0x7f30480ecb00 msgr2=0x7f304810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:12.043 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.040+0000 7f30502316c0 1 -- 10.20.193.40:0/597717954 shutdown_connections 2026-02-13T01:26:12.043 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.040+0000 7f30502316c0 1 -- 10.20.193.40:0/597717954 wait complete. 2026-02-13T01:26:12.045 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.041+0000 7f30502316c0 1 Processor -- start 2026-02-13T01:26:12.045 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.041+0000 7f30502316c0 1 -- start start 2026-02-13T01:26:12.045 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.041+0000 7f30502316c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f304810f200 0x7f304811cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:12.045 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.041+0000 7f30502316c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3048115410 0x7f304811d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:12.045 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.041+0000 7f30502316c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3048122830 0x7f3048122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:12.045 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.041+0000 7f30502316c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3048123240 con 0x7f3048122830 2026-02-13T01:26:12.045 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.041+0000 7f30502316c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f30481233b0 con 0x7f304810f200 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.041+0000 7f30502316c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3048123570 con 0x7f3048115410 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.041+0000 7f304dfa26c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f304810f200 0x7f304811cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304dfa26c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f304810f200 0x7f304811cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:50754/0 (socket says 10.20.193.40:50754) 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304dfa26c0 1 -- 10.20.193.40:0/4181387070 learned_addr learned my addr 10.20.193.40:0/4181387070 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304e7a36c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3048122830 0x7f3048122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304d7a16c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3048115410 0x7f304811d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304dfa26c0 1 -- 10.20.193.40:0/4181387070 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3048115410 msgr2=0x7f304811d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304dfa26c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3048115410 0x7f304811d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304dfa26c0 1 -- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3048122830 msgr2=0x7f3048122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304dfa26c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3048122830 0x7f3048122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304dfa26c0 1 -- 10.20.193.40:0/4181387070 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303c0094c0 con 0x7f304810f200 2026-02-13T01:26:12.046 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f304dfa26c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f304810f200 0x7f304811cf30 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30380092e0 tx=0x7f303800bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:12.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f3036ffd6c0 1 -- 10.20.193.40:0/4181387070 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3038004250 con 0x7f304810f200 2026-02-13T01:26:12.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f3036ffd6c0 1 -- 10.20.193.40:0/4181387070 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f30380043b0 con 0x7f304810f200 2026-02-13T01:26:12.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f3036ffd6c0 1 -- 10.20.193.40:0/4181387070 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30380072a0 con 0x7f304810f200 2026-02-13T01:26:12.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f304400a660 con 0x7f304810f200 2026-02-13T01:26:12.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.042+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3048163d20 con 0x7f304810f200 2026-02-13T01:26:12.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.043+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30481104d0 con 0x7f304810f200 2026-02-13T01:26:12.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.045+0000 7f3036ffd6c0 1 -- 10.20.193.40:0/4181387070 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f303800c560 con 0x7f304810f200 2026-02-13T01:26:12.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.047+0000 7f3036ffd6c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f30240b5650 0x7f30240d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:12.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.047+0000 7f3036ffd6c0 1 -- 10.20.193.40:0/4181387070 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f30380e3af0 con 0x7f304810f200 2026-02-13T01:26:12.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.047+0000 7f304d7a16c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f30240b5650 0x7f30240d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:12.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.047+0000 7f3036ffd6c0 1 -- 10.20.193.40:0/4181387070 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f303811c5e0 con 0x7f304810f200 2026-02-13T01:26:12.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.048+0000 7f304d7a16c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f30240b5650 0x7f30240d5b00 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30481238c0 tx=0x7f303c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.171+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f304811e0b0 con 0x7f304810f200 2026-02-13T01:26:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.171+0000 7f3036ffd6c0 1 -- 10.20.193.40:0/4181387070 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f30380a6490 con 0x7f304810f200 2026-02-13T01:26:12.173 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:12.173 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f30240b5650 msgr2=0x7f30240d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f30240b5650 0x7f30240d5b00 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30481238c0 tx=0x7f303c009260 comp rx=0 tx=0).stop 2026-02-13T01:26:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f304810f200 msgr2=0x7f304811cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f304810f200 0x7f304811cf30 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30380092e0 tx=0x7f303800bc50 comp rx=0 tx=0).stop 2026-02-13T01:26:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 shutdown_connections 2026-02-13T01:26:12.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f30240b5650 0x7f30240d5b00 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3048122830 0x7f3048122cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3048115410 0x7f304811d470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 --2- 10.20.193.40:0/4181387070 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f304810f200 0x7f304811cf30 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 >> 10.20.193.40:0/4181387070 conn(0x7f30480ecb00 msgr2=0x7f304810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:12.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 shutdown_connections 2026-02-13T01:26:12.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:12.173+0000 7f30502316c0 1 -- 10.20.193.40:0/4181387070 wait complete. 2026-02-13T01:26:12.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:11 trial055 ceph-mon[27509]: pgmap v250: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:12.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:11 trial118 ceph-mon[27812]: pgmap v250: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:13.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:12 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4181387070' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:13.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:12 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4181387070' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:13.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:12 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4181387070' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:14.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:13 trial055 ceph-mon[27509]: pgmap v251: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:14.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:13 trial040 ceph-mon[23046]: pgmap v251: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:14.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:13 trial118 ceph-mon[27812]: pgmap v251: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:15.276 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:15.463 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:15.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.662+0000 7f80e2e876c0 1 -- 10.20.193.40:0/708689198 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc10f060 msgr2=0x7f80dc10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:15.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.662+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/708689198 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc10f060 0x7f80dc10f430 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=16997767342194696256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80cc0099a0 tx=0x7f80cc02ed50 comp rx=0 tx=0).stop 2026-02-13T01:26:15.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.662+0000 7f80e2e876c0 1 -- 10.20.193.40:0/708689198 shutdown_connections 2026-02-13T01:26:15.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.662+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/708689198 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f80dc115270 0x7f80dc175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.662+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/708689198 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f80dc10fa50 0x7f80dc114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.662+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/708689198 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc10f060 0x7f80dc10f430 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=16997767342194696256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.662+0000 7f80e2e876c0 1 -- 10.20.193.40:0/708689198 >> 10.20.193.40:0/708689198 conn(0x7f80dc0ec980 msgr2=0x7f80dc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:15.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.662+0000 7f80e2e876c0 1 -- 10.20.193.40:0/708689198 shutdown_connections 2026-02-13T01:26:15.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.662+0000 7f80e2e876c0 1 -- 10.20.193.40:0/708689198 wait complete. 2026-02-13T01:26:15.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e2e876c0 1 Processor -- start 2026-02-13T01:26:15.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e2e876c0 1 -- start start 2026-02-13T01:26:15.666 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e2e876c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f80dc10f060 0x7f80dc11ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e2e876c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f80dc115270 0x7f80dc11d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e2e876c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc122790 0x7f80dc122c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e2e876c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1231a0 con 0x7f80dc122790 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e2e876c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc123310 con 0x7f80dc115270 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e2e876c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1234d0 con 0x7f80dc10f060 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e26866c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc122790 0x7f80dc122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e26866c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc122790 0x7f80dc122c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:38092/0 (socket says 10.20.193.40:38092) 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e26866c0 1 -- 10.20.193.40:0/456244049 learned_addr learned my addr 10.20.193.40:0/456244049 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e16846c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f80dc115270 0x7f80dc11d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:15.667 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.663+0000 7f80e1e856c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f80dc10f060 0x7f80dc11ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80e26866c0 1 -- 10.20.193.40:0/456244049 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f80dc10f060 msgr2=0x7f80dc11ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80e26866c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f80dc10f060 0x7f80dc11ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80e26866c0 1 -- 10.20.193.40:0/456244049 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f80dc115270 msgr2=0x7f80dc11d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80e26866c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f80dc115270 0x7f80dc11d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80e26866c0 1 -- 10.20.193.40:0/456244049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80cc009590 con 0x7f80dc122790 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80e26866c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc122790 0x7f80dc122c30 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80d8006ea0 tx=0x7f80d800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80cb7fe6c0 1 -- 10.20.193.40:0/456244049 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80d8003a30 con 0x7f80dc122790 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80cb7fe6c0 1 -- 10.20.193.40:0/456244049 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f80d8005560 con 0x7f80dc122790 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80dc163980 con 0x7f80dc122790 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80cb7fe6c0 1 -- 10.20.193.40:0/456244049 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80d80082a0 con 0x7f80dc122790 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.664+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80dc163e60 con 0x7f80dc122790 2026-02-13T01:26:15.668 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.665+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80dc110330 con 0x7f80dc122790 2026-02-13T01:26:15.669 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.667+0000 7f80cb7fe6c0 1 -- 10.20.193.40:0/456244049 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f80d800d4d0 con 0x7f80dc122790 2026-02-13T01:26:15.670 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.669+0000 7f80cb7fe6c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80ac0b56d0 0x7f80ac0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:15.670 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.669+0000 7f80cb7fe6c0 1 -- 10.20.193.40:0/456244049 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f80d80e4c30 con 0x7f80dc122790 2026-02-13T01:26:15.670 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.669+0000 7f80e1e856c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80ac0b56d0 0x7f80ac0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:15.670 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.669+0000 7f80cb7fe6c0 1 -- 10.20.193.40:0/456244049 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f80d80e50b0 con 0x7f80dc122790 2026-02-13T01:26:15.671 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.669+0000 7f80e1e856c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80ac0b56d0 0x7f80ac0d5b80 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80cc005b40 tx=0x7f80cc005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:15.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.792+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f80dc10f430 con 0x7f80dc122790 2026-02-13T01:26:15.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.793+0000 7f80cb7fe6c0 1 -- 10.20.193.40:0/456244049 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f80d80a75d0 con 0x7f80dc122790 2026-02-13T01:26:15.794 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:15.795 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:15.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80ac0b56d0 msgr2=0x7f80ac0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80ac0b56d0 0x7f80ac0d5b80 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80cc005b40 tx=0x7f80cc005c00 comp rx=0 tx=0).stop 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc122790 msgr2=0x7f80dc122c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc122790 0x7f80dc122c30 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80d8006ea0 tx=0x7f80d800cca0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 shutdown_connections 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f80ac0b56d0 0x7f80ac0d5b80 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f80dc122790 0x7f80dc122c30 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f80dc115270 0x7f80dc11d3d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 --2- 10.20.193.40:0/456244049 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f80dc10f060 0x7f80dc11ce90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 >> 10.20.193.40:0/456244049 conn(0x7f80dc0ec980 msgr2=0x7f80dc10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:15.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 shutdown_connections 2026-02-13T01:26:15.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:15.794+0000 7f80e2e876c0 1 -- 10.20.193.40:0/456244049 wait complete. 2026-02-13T01:26:16.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:15 trial055 ceph-mon[27509]: pgmap v252: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:16.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:15 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/456244049' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:16.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:15 trial040 ceph-mon[23046]: pgmap v252: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:16.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:15 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/456244049' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:16.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:15 trial118 ceph-mon[27812]: pgmap v252: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:16.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:15 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/456244049' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:18.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:17 trial055 ceph-mon[27509]: pgmap v253: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:18.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:17 trial040 ceph-mon[23046]: pgmap v253: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:18.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:17 trial118 ceph-mon[27812]: pgmap v253: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:18.899 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:19.087 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:19.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.272+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1586624339 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115b40 msgr2=0x7f947811a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.272+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1586624339 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115b40 0x7f947811a310 secure :-1 s=READY pgs=302 gs=2 cs=0 l=1 c_cookie=17269375247312596737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94600099a0 tx=0x7f946002ed00 comp rx=0 tx=0).stop 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.272+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1586624339 shutdown_connections 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.272+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1586624339 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f947811aaf0 0x7f947817b490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.272+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1586624339 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115b40 0x7f947811a310 unknown :-1 s=CLOSED pgs=302 gs=2 cs=0 l=1 c_cookie=17269375247312596737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.272+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1586624339 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f9478115150 0x7f9478115520 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.272+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1586624339 >> 10.20.193.40:0/1586624339 conn(0x7f947805c880 msgr2=0x7f9478058b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.272+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1586624339 shutdown_connections 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.272+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1586624339 wait complete. 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947efbc6c0 1 Processor -- start 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947efbc6c0 1 -- start start 2026-02-13T01:26:19.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947efbc6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115150 0x7f9478100100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947efbc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f947811aaf0 0x7f947817b390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947efbc6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9478100730 0x7f9478105a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947efbc6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9478100e20 con 0x7f9478115150 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947efbc6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f9478105f40 con 0x7f947811aaf0 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947efbc6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9478106100 con 0x7f9478100730 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947cd316c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115150 0x7f9478100100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947cd316c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115150 0x7f9478100100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:38110/0 (socket says 10.20.193.40:38110) 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947cd316c0 1 -- 10.20.193.40:0/1228933356 learned_addr learned my addr 10.20.193.40:0/1228933356 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f946ffff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f947811aaf0 0x7f947817b390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:19.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947d5326c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9478100730 0x7f9478105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:19.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947cd316c0 1 -- 10.20.193.40:0/1228933356 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9478100730 msgr2=0x7f9478105a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947cd316c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9478100730 0x7f9478105a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947cd316c0 1 -- 10.20.193.40:0/1228933356 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f947811aaf0 msgr2=0x7f947817b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947cd316c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f947811aaf0 0x7f947817b390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f947cd316c0 1 -- 10.20.193.40:0/1228933356 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9460009590 con 0x7f9478115150 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.273+0000 7f946ffff6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f947811aaf0 0x7f947817b390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.274+0000 7f947cd316c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115150 0x7f9478100100 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f946800b710 tx=0x7f946800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.274+0000 7f946dffb6c0 1 -- 10.20.193.40:0/1228933356 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9468004250 con 0x7f9478115150 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.274+0000 7f946dffb6c0 1 -- 10.20.193.40:0/1228933356 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9468009070 con 0x7f9478115150 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.274+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94781063e0 con 0x7f9478115150 2026-02-13T01:26:19.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.274+0000 7f946dffb6c0 1 -- 10.20.193.40:0/1228933356 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f946800ce40 con 0x7f9478115150 2026-02-13T01:26:19.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.274+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9478106b70 con 0x7f9478115150 2026-02-13T01:26:19.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.274+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94780565c0 con 0x7f9478115150 2026-02-13T01:26:19.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.277+0000 7f946dffb6c0 1 -- 10.20.193.40:0/1228933356 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f94680043b0 con 0x7f9478115150 2026-02-13T01:26:19.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.278+0000 7f946dffb6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f94540b56d0 0x7f94540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:19.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.278+0000 7f946dffb6c0 1 -- 10.20.193.40:0/1228933356 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f94680e3a80 con 0x7f9478115150 2026-02-13T01:26:19.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.279+0000 7f946dffb6c0 1 -- 10.20.193.40:0/1228933356 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f946811c5e0 con 0x7f9478115150 2026-02-13T01:26:19.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.279+0000 7f946ffff6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f94540b56d0 0x7f94540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:19.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.279+0000 7f946ffff6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f94540b56d0 0x7f94540d5b80 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9478106a90 tx=0x7f94600023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:19.405 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.403+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9478101250 con 0x7f9478115150 2026-02-13T01:26:19.405 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.403+0000 7f946dffb6c0 1 -- 10.20.193.40:0/1228933356 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f94680a6420 con 0x7f9478115150 2026-02-13T01:26:19.405 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:19.405 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:19.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f94540b56d0 msgr2=0x7f94540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f94540b56d0 0x7f94540d5b80 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9478106a90 tx=0x7f94600023a0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115150 msgr2=0x7f9478100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115150 0x7f9478100100 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f946800b710 tx=0x7f946800bbe0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 shutdown_connections 2026-02-13T01:26:19.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f94540b56d0 0x7f94540d5b80 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9478100730 0x7f9478105a00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f947811aaf0 0x7f947817b390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 --2- 10.20.193.40:0/1228933356 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9478115150 0x7f9478100100 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 >> 10.20.193.40:0/1228933356 conn(0x7f947805c880 msgr2=0x7f9478118250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:19.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.404+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 shutdown_connections 2026-02-13T01:26:19.407 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:19.405+0000 7f947efbc6c0 1 -- 10.20.193.40:0/1228933356 wait complete. 2026-02-13T01:26:20.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:19 trial055 ceph-mon[27509]: pgmap v254: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:20.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:19 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1228933356' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:19 trial040 ceph-mon[23046]: pgmap v254: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:19 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1228933356' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:20.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:19 trial118 ceph-mon[27812]: pgmap v254: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:20.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:19 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1228933356' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:22.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:21 trial055 ceph-mon[27509]: pgmap v255: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:22.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:21 trial040 ceph-mon[23046]: pgmap v255: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:22.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:21 trial118 ceph-mon[27812]: pgmap v255: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:22.543 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:22.727 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:22.926 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/2068707266 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef811b510 msgr2=0x7f3ef811b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:22.926 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/2068707266 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef811b510 0x7f3ef811b8e0 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=8217943175690224064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ee8009970 tx=0x7f3ee802ed50 comp rx=0 tx=0).stop 2026-02-13T01:26:22.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/2068707266 shutdown_connections 2026-02-13T01:26:22.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/2068707266 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3ef81149c0 0x7f3ef8114ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/2068707266 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3ef8113dc0 0x7f3ef8114210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/2068707266 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef811b510 0x7f3ef811b8e0 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=8217943175690224064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/2068707266 >> 10.20.193.40:0/2068707266 conn(0x7f3ef8058a50 msgr2=0x7f3ef8058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:22.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/2068707266 shutdown_connections 2026-02-13T01:26:22.927 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/2068707266 wait complete. 2026-02-13T01:26:22.929 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.925+0000 7f3f0060b6c0 1 Processor -- start 2026-02-13T01:26:22.929 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3f0060b6c0 1 -- start start 2026-02-13T01:26:22.929 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3f0060b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3ef8113dc0 0x7f3ef812b690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3f0060b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef81149c0 0x7f3ef812bbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3f0060b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3ef811b510 0x7f3ef8130f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3f0060b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef81315e0 con 0x7f3ef81149c0 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3f0060b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8131750 con 0x7f3ef8113dc0 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3f0060b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8131910 con 0x7f3ef811b510 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efdb7b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef81149c0 0x7f3ef812bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efdb7b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef81149c0 0x7f3ef812bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:42770/0 (socket says 10.20.193.40:42770) 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efdb7b6c0 1 -- 10.20.193.40:0/1448825175 learned_addr learned my addr 10.20.193.40:0/1448825175 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efe37c6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3ef8113dc0 0x7f3ef812b690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:22.930 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efeb7d6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3ef811b510 0x7f3ef8130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efdb7b6c0 1 -- 10.20.193.40:0/1448825175 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3ef811b510 msgr2=0x7f3ef8130f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efdb7b6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3ef811b510 0x7f3ef8130f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efdb7b6c0 1 -- 10.20.193.40:0/1448825175 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3ef8113dc0 msgr2=0x7f3ef812b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efdb7b6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3ef8113dc0 0x7f3ef812b690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.926+0000 7f3efdb7b6c0 1 -- 10.20.193.40:0/1448825175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee8009590 con 0x7f3ef81149c0 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.927+0000 7f3efdb7b6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef81149c0 0x7f3ef812bbd0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3eec009490 tx=0x7f3eec00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.927+0000 7f3edf7fe6c0 1 -- 10.20.193.40:0/1448825175 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3eec004a80 con 0x7f3ef81149c0 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.927+0000 7f3edf7fe6c0 1 -- 10.20.193.40:0/1448825175 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3eec009030 con 0x7f3ef81149c0 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.927+0000 7f3edf7fe6c0 1 -- 10.20.193.40:0/1448825175 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3eec0071c0 con 0x7f3ef81149c0 2026-02-13T01:26:22.931 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.927+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef8131bf0 con 0x7f3ef81149c0 2026-02-13T01:26:22.932 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.927+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef81722d0 con 0x7f3ef81149c0 2026-02-13T01:26:22.932 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.927+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef8131e10 con 0x7f3ef81149c0 2026-02-13T01:26:22.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.929+0000 7f3edf7fe6c0 1 -- 10.20.193.40:0/1448825175 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f3eec004e90 con 0x7f3ef81149c0 2026-02-13T01:26:22.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.931+0000 7f3edf7fe6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3ed40b56d0 0x7f3ed40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:22.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.931+0000 7f3edf7fe6c0 1 -- 10.20.193.40:0/1448825175 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f3eec0e3aa0 con 0x7f3ef81149c0 2026-02-13T01:26:22.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.931+0000 7f3efe37c6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3ed40b56d0 0x7f3ed40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:22.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.931+0000 7f3edf7fe6c0 1 -- 10.20.193.40:0/1448825175 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3eec11c5e0 con 0x7f3ef81149c0 2026-02-13T01:26:22.933 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:22.932+0000 7f3efe37c6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3ed40b56d0 0x7f3ed40d5b80 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ee8005b40 tx=0x7f3ee80023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:23.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.056+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3ef805b000 con 0x7f3ef81149c0 2026-02-13T01:26:23.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.056+0000 7f3edf7fe6c0 1 -- 10.20.193.40:0/1448825175 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3eec0a6440 con 0x7f3ef81149c0 2026-02-13T01:26:23.058 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:23.058 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:23.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3ed40b56d0 msgr2=0x7f3ed40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:23.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3ed40b56d0 0x7f3ed40d5b80 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ee8005b40 tx=0x7f3ee80023a0 comp rx=0 tx=0).stop 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef81149c0 msgr2=0x7f3ef812bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef81149c0 0x7f3ef812bbd0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3eec009490 tx=0x7f3eec00bc50 comp rx=0 tx=0).stop 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 shutdown_connections 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f3ed40b56d0 0x7f3ed40d5b80 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f3ef811b510 0x7f3ef8130f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3ef81149c0 0x7f3ef812bbd0 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 --2- 10.20.193.40:0/1448825175 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3ef8113dc0 0x7f3ef812b690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.057+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 >> 10.20.193.40:0/1448825175 conn(0x7f3ef8058a50 msgr2=0x7f3ef811a360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.058+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 shutdown_connections 2026-02-13T01:26:23.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:23.058+0000 7f3f0060b6c0 1 -- 10.20.193.40:0/1448825175 wait complete. 2026-02-13T01:26:24.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:23 trial055 ceph-mon[27509]: pgmap v256: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:24.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:23 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1448825175' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:23 trial040 ceph-mon[23046]: pgmap v256: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:24.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:23 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1448825175' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:24.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:23 trial118 ceph-mon[27812]: pgmap v256: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:24.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:23 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1448825175' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:26.165 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:26.217 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:25 trial040 ceph-mon[23046]: pgmap v257: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:26.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:25 trial055 ceph-mon[27509]: pgmap v257: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:26.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:25 trial118 ceph-mon[27812]: pgmap v257: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:26.352 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.547+0000 7fd7235776c0 1 -- 10.20.193.40:0/130820749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd72410fa50 msgr2=0x7fd724114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.547+0000 7fd7235776c0 1 --2- 10.20.193.40:0/130820749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd72410fa50 0x7fd724114a90 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=10427975517686271957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd70c009970 tx=0x7fd70c02ed10 comp rx=0 tx=0).stop 2026-02-13T01:26:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.547+0000 7fd7235776c0 1 -- 10.20.193.40:0/130820749 shutdown_connections 2026-02-13T01:26:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.547+0000 7fd7235776c0 1 --2- 10.20.193.40:0/130820749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd724115270 0x7fd724175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.547+0000 7fd7235776c0 1 --2- 10.20.193.40:0/130820749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd72410fa50 0x7fd724114a90 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=10427975517686271957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.547+0000 7fd7235776c0 1 --2- 10.20.193.40:0/130820749 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd72410f060 0x7fd72410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.547+0000 7fd7235776c0 1 -- 10.20.193.40:0/130820749 >> 10.20.193.40:0/130820749 conn(0x7fd7240ec980 msgr2=0x7fd72410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.547+0000 7fd7235776c0 1 -- 10.20.193.40:0/130820749 shutdown_connections 2026-02-13T01:26:26.550 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.547+0000 7fd7235776c0 1 -- 10.20.193.40:0/130820749 wait complete. 2026-02-13T01:26:26.551 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd7235776c0 1 Processor -- start 2026-02-13T01:26:26.551 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd7235776c0 1 -- start start 2026-02-13T01:26:26.551 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd7235776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd72410f060 0x7fd72411ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd7235776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd724115270 0x7fd72411d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd7235776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd724122790 0x7fd724122c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd7235776c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd7241231a0 con 0x7fd724122790 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd7235776c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd724123310 con 0x7fd724115270 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd7235776c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd7241234d0 con 0x7fd72410f060 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd722d766c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd724122790 0x7fd724122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd722d766c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd724122790 0x7fd724122c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:42782/0 (socket says 10.20.193.40:42782) 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd721d746c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd724115270 0x7fd72411d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd722d766c0 1 -- 10.20.193.40:0/1378442595 learned_addr learned my addr 10.20.193.40:0/1378442595 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.548+0000 7fd7225756c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd72410f060 0x7fd72411ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:26.552 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd722d766c0 1 -- 10.20.193.40:0/1378442595 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd72410f060 msgr2=0x7fd72411ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd722d766c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd72410f060 0x7fd72411ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd722d766c0 1 -- 10.20.193.40:0/1378442595 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd724115270 msgr2=0x7fd72411d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd722d766c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd724115270 0x7fd72411d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd722d766c0 1 -- 10.20.193.40:0/1378442595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71400a5b0 con 0x7fd724122790 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd722d766c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd724122790 0x7fd724122c30 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd71400a820 tx=0x7fd71400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd70b7fe6c0 1 -- 10.20.193.40:0/1378442595 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd714003c40 con 0x7fd724122790 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd70b7fe6c0 1 -- 10.20.193.40:0/1378442595 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd71400a070 con 0x7fd724122790 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c009590 con 0x7fd724122790 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd70b7fe6c0 1 -- 10.20.193.40:0/1378442595 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd714008440 con 0x7fd724122790 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd724163cd0 con 0x7fd724122790 2026-02-13T01:26:26.553 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.549+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd724110330 con 0x7fd724122790 2026-02-13T01:26:26.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.551+0000 7fd70b7fe6c0 1 -- 10.20.193.40:0/1378442595 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fd71400d7a0 con 0x7fd724122790 2026-02-13T01:26:26.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.553+0000 7fd70b7fe6c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd6fc0b56d0 0x7fd6fc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:26.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.553+0000 7fd70b7fe6c0 1 -- 10.20.193.40:0/1378442595 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fd7140e4c20 con 0x7fd724122790 2026-02-13T01:26:26.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.553+0000 7fd7225756c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd6fc0b56d0 0x7fd6fc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:26.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.553+0000 7fd70b7fe6c0 1 -- 10.20.193.40:0/1378442595 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd7140e5110 con 0x7fd724122790 2026-02-13T01:26:26.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.553+0000 7fd7225756c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd6fc0b56d0 0x7fd6fc0d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd718004750 tx=0x7fd718009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:26.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.680+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd72411e010 con 0x7fd724122790 2026-02-13T01:26:26.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.681+0000 7fd70b7fe6c0 1 -- 10.20.193.40:0/1378442595 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd7140a7600 con 0x7fd724122790 2026-02-13T01:26:26.682 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:26.682 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:26.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd6fc0b56d0 msgr2=0x7fd6fc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd6fc0b56d0 0x7fd6fc0d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd718004750 tx=0x7fd718009260 comp rx=0 tx=0).stop 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd724122790 msgr2=0x7fd724122c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd724122790 0x7fd724122c30 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd71400a820 tx=0x7fd71400ce50 comp rx=0 tx=0).stop 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 shutdown_connections 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd6fc0b56d0 0x7fd6fc0d5b80 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd724122790 0x7fd724122c30 unknown :-1 s=CLOSED pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd724115270 0x7fd72411d3d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 --2- 10.20.193.40:0/1378442595 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd72410f060 0x7fd72411ce90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 >> 10.20.193.40:0/1378442595 conn(0x7fd7240ec980 msgr2=0x7fd72410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 shutdown_connections 2026-02-13T01:26:26.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:26.682+0000 7fd7235776c0 1 -- 10.20.193.40:0/1378442595 wait complete. 2026-02-13T01:26:26.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:26 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1378442595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:27.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:26 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1378442595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:27.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:26 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1378442595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:28.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:27 trial055 ceph-mon[27509]: pgmap v258: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:28.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:27 trial040 ceph-mon[23046]: pgmap v258: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:28.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:27 trial118 ceph-mon[27812]: pgmap v258: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:29.822 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:30.006 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:30.097 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:29 trial040 ceph-mon[23046]: pgmap v259: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:30.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.206+0000 7f33989d36c0 1 -- 10.20.193.40:0/2900661799 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 msgr2=0x7f3394113dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:30.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.206+0000 7f33989d36c0 1 --2- 10.20.193.40:0/2900661799 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 0x7f3394113dc0 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=13755636219236518239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3388009970 tx=0x7f338802ed10 comp rx=0 tx=0).stop 2026-02-13T01:26:30.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.206+0000 7f33989d36c0 1 -- 10.20.193.40:0/2900661799 shutdown_connections 2026-02-13T01:26:30.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.206+0000 7f33989d36c0 1 --2- 10.20.193.40:0/2900661799 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f339415dfa0 0x7f339417e380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.206+0000 7f33989d36c0 1 --2- 10.20.193.40:0/2900661799 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3394114300 0x7f3394114730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.206+0000 7f33989d36c0 1 --2- 10.20.193.40:0/2900661799 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 0x7f3394113dc0 unknown :-1 s=CLOSED pgs=307 gs=1 cs=0 l=1 c_cookie=13755636219236518239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.206+0000 7f33989d36c0 1 -- 10.20.193.40:0/2900661799 >> 10.20.193.40:0/2900661799 conn(0x7f339405b290 msgr2=0x7f339405b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:30.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.206+0000 7f33989d36c0 1 -- 10.20.193.40:0/2900661799 shutdown_connections 2026-02-13T01:26:30.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.206+0000 7f33989d36c0 1 -- 10.20.193.40:0/2900661799 wait complete. 2026-02-13T01:26:30.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.207+0000 7f33989d36c0 1 Processor -- start 2026-02-13T01:26:30.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.207+0000 7f33989d36c0 1 -- start start 2026-02-13T01:26:30.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.207+0000 7f33989d36c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3394114300 0x7f33940fd080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:30.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.207+0000 7f33989d36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 0x7f33940fd5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33989d36c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f339415dfa0 0x7f3394102930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33989d36c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3394102f80 con 0x7f3394117340 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33989d36c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f33941030f0 con 0x7f3394114300 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33989d36c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f33941032b0 con 0x7f339415dfa0 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33925756c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 0x7f33940fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33925756c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 0x7f33940fd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:56440/0 (socket says 10.20.193.40:56440) 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33925756c0 1 -- 10.20.193.40:0/1360957466 learned_addr learned my addr 10.20.193.40:0/1360957466 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f3392d766c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3394114300 0x7f33940fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33935776c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f339415dfa0 0x7f3394102930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33925756c0 1 -- 10.20.193.40:0/1360957466 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f339415dfa0 msgr2=0x7f3394102930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:30.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33925756c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f339415dfa0 0x7f3394102930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33925756c0 1 -- 10.20.193.40:0/1360957466 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3394114300 msgr2=0x7f33940fd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33925756c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3394114300 0x7f33940fd080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33925756c0 1 -- 10.20.193.40:0/1360957466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3388009590 con 0x7f3394117340 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33925756c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 0x7f33940fd5c0 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f337c00b710 tx=0x7f337c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f3373fff6c0 1 -- 10.20.193.40:0/1360957466 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f337c004250 con 0x7f3394117340 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f3373fff6c0 1 -- 10.20.193.40:0/1360957466 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f337c009070 con 0x7f3394117340 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f3373fff6c0 1 -- 10.20.193.40:0/1360957466 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f337c0071c0 con 0x7f3394117340 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3394103590 con 0x7f3394117340 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.208+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339415c130 con 0x7f3394117340 2026-02-13T01:26:30.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.209+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33941037b0 con 0x7f3394117340 2026-02-13T01:26:30.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.211+0000 7f3373fff6c0 1 -- 10.20.193.40:0/1360957466 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f337c0043b0 con 0x7f3394117340 2026-02-13T01:26:30.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.213+0000 7f3373fff6c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33640b56d0 0x7f33640d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:30.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.213+0000 7f3373fff6c0 1 -- 10.20.193.40:0/1360957466 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f337c0e3b90 con 0x7f3394117340 2026-02-13T01:26:30.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.213+0000 7f3392d766c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33640b56d0 0x7f33640d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:30.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.213+0000 7f3373fff6c0 1 -- 10.20.193.40:0/1360957466 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f337c11c600 con 0x7f3394117340 2026-02-13T01:26:30.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.213+0000 7f3392d766c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33640b56d0 0x7f33640d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33880023e0 tx=0x7f3388005c60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:30.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:29 trial055 ceph-mon[27509]: pgmap v259: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:30.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:29 trial118 ceph-mon[27812]: pgmap v259: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:30.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.337+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f33940fe180 con 0x7f3394117340 2026-02-13T01:26:30.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.337+0000 7f3373fff6c0 1 -- 10.20.193.40:0/1360957466 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f337c0a6530 con 0x7f3394117340 2026-02-13T01:26:30.339 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:30.339 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:30.339 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33640b56d0 msgr2=0x7f33640d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33640b56d0 0x7f33640d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33880023e0 tx=0x7f3388005c60 comp rx=0 tx=0).stop 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 msgr2=0x7f33940fd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 0x7f33940fd5c0 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f337c00b710 tx=0x7f337c00bbe0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 shutdown_connections 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f33640b56d0 0x7f33640d5b80 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f339415dfa0 0x7f3394102930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3394117340 0x7f33940fd5c0 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 --2- 10.20.193.40:0/1360957466 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3394114300 0x7f33940fd080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 >> 10.20.193.40:0/1360957466 conn(0x7f339405b290 msgr2=0x7f33940f3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 shutdown_connections 2026-02-13T01:26:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:30.338+0000 7f33989d36c0 1 -- 10.20.193.40:0/1360957466 wait complete. 2026-02-13T01:26:31.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:30 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1360957466' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:31.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:30 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1360957466' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:31.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:30 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1360957466' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:32.154 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:31 trial118 ceph-mon[27812]: pgmap v260: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:32.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:31 trial055 ceph-mon[27509]: pgmap v260: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:32.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:31 trial040 ceph-mon[23046]: pgmap v260: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:33.444 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:33.632 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:33.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.828+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/4275237791 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f010fbf0 msgr2=0x7f47f0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.828+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/4275237791 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f010fbf0 0x7f47f0114c30 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=4225287513888249573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47e40099a0 tx=0x7f47e402ed00 comp rx=0 tx=0).stop 2026-02-13T01:26:33.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.828+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/4275237791 shutdown_connections 2026-02-13T01:26:33.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.828+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/4275237791 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47f0115410 0x7f47f0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.828+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/4275237791 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f010fbf0 0x7f47f0114c30 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=4225287513888249573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.828+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/4275237791 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47f010f200 0x7f47f010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.828+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/4275237791 >> 10.20.193.40:0/4275237791 conn(0x7f47f00ecb00 msgr2=0x7f47f010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:33.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.828+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/4275237791 shutdown_connections 2026-02-13T01:26:33.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.828+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/4275237791 wait complete. 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f7cb86c0 1 Processor -- start 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f7cb86c0 1 -- start start 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f7cb86c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47f010f200 0x7f47f00f4990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f7cb86c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f0115410 0x7f47f0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f7cb86c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47f00f4fc0 0x7f47f00fa240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f7cb86c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00f56b0 con 0x7f47f0115410 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f7cb86c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00fa780 con 0x7f47f010f200 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f7cb86c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00fa940 con 0x7f47f00f4fc0 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f52286c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f0115410 0x7f47f0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f52286c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f0115410 0x7f47f0175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:56452/0 (socket says 10.20.193.40:56452) 2026-02-13T01:26:33.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f52286c0 1 -- 10.20.193.40:0/3235218126 learned_addr learned my addr 10.20.193.40:0/3235218126 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f622a6c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47f00f4fc0 0x7f47f00fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f5a296c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47f010f200 0x7f47f00f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f52286c0 1 -- 10.20.193.40:0/3235218126 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47f00f4fc0 msgr2=0x7f47f00fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f52286c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47f00f4fc0 0x7f47f00fa240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f52286c0 1 -- 10.20.193.40:0/3235218126 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47f010f200 msgr2=0x7f47f00f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f52286c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47f010f200 0x7f47f00f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f52286c0 1 -- 10.20.193.40:0/3235218126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e4009590 con 0x7f47f0115410 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.829+0000 7f47f52286c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f0115410 0x7f47f0175cb0 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47e40092e0 tx=0x7f47e402f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.830+0000 7f47deffd6c0 1 -- 10.20.193.40:0/3235218126 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47e40046b0 con 0x7f47f0115410 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.830+0000 7f47deffd6c0 1 -- 10.20.193.40:0/3235218126 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f47e4002be0 con 0x7f47f0115410 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.830+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f00fabc0 con 0x7f47f0115410 2026-02-13T01:26:33.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.830+0000 7f47deffd6c0 1 -- 10.20.193.40:0/3235218126 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47e40073f0 con 0x7f47f0115410 2026-02-13T01:26:33.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.830+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f00fb090 con 0x7f47f0115410 2026-02-13T01:26:33.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.830+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f01104d0 con 0x7f47f0115410 2026-02-13T01:26:33.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.833+0000 7f47deffd6c0 1 -- 10.20.193.40:0/3235218126 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f47e40026b0 con 0x7f47f0115410 2026-02-13T01:26:33.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.835+0000 7f47deffd6c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47cc0b56d0 0x7f47cc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:33.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.835+0000 7f47deffd6c0 1 -- 10.20.193.40:0/3235218126 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f47e4107b50 con 0x7f47f0115410 2026-02-13T01:26:33.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.835+0000 7f47f5a296c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47cc0b56d0 0x7f47cc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:33.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.835+0000 7f47deffd6c0 1 -- 10.20.193.40:0/3235218126 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f47e41405e0 con 0x7f47f0115410 2026-02-13T01:26:33.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.835+0000 7f47f5a296c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47cc0b56d0 0x7f47cc0d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47e0004750 tx=0x7f47e0009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:33.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.960+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f47f010f5d0 con 0x7f47f0115410 2026-02-13T01:26:33.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.960+0000 7f47deffd6c0 1 -- 10.20.193.40:0/3235218126 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f47e40ca4f0 con 0x7f47f0115410 2026-02-13T01:26:33.962 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:33.962 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:33.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.961+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47cc0b56d0 msgr2=0x7f47cc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.961+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47cc0b56d0 0x7f47cc0d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47e0004750 tx=0x7f47e0009390 comp rx=0 tx=0).stop 2026-02-13T01:26:33.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f0115410 msgr2=0x7f47f0175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f0115410 0x7f47f0175cb0 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47e40092e0 tx=0x7f47e402f810 comp rx=0 tx=0).stop 2026-02-13T01:26:33.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 shutdown_connections 2026-02-13T01:26:33.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f47cc0b56d0 0x7f47cc0d5b80 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f47f00f4fc0 0x7f47f00fa240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f47f0115410 0x7f47f0175cb0 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 --2- 10.20.193.40:0/3235218126 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f47f010f200 0x7f47f00f4990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 >> 10.20.193.40:0/3235218126 conn(0x7f47f00ecb00 msgr2=0x7f47f010d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:33.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 shutdown_connections 2026-02-13T01:26:33.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:33.962+0000 7f47f7cb86c0 1 -- 10.20.193.40:0/3235218126 wait complete. 2026-02-13T01:26:34.022 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:33 trial040 ceph-mon[23046]: pgmap v261: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:34.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:33 trial055 ceph-mon[27509]: pgmap v261: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:34.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:33 trial118 ceph-mon[27812]: pgmap v261: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:35.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:34 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3235218126' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:35.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:34 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3235218126' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:35.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:34 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3235218126' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:36.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:35 trial055 ceph-mon[27509]: pgmap v262: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:36.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:35 trial040 ceph-mon[23046]: pgmap v262: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:36.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:35 trial118 ceph-mon[27812]: pgmap v262: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:37.067 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:37.119 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:36 trial040 ceph-mon[23046]: pgmap v263: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:37.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:36 trial055 ceph-mon[27509]: pgmap v263: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:37.253 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:37.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:36 trial118 ceph-mon[27812]: pgmap v263: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:37.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.447+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/4138756613 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa410f200 msgr2=0x7f8aa410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:37.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.447+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/4138756613 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa410f200 0x7f8aa410f5d0 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=4590992742716078026 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a940099a0 tx=0x7f8a9402ed00 comp rx=0 tx=0).stop 2026-02-13T01:26:37.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.447+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/4138756613 shutdown_connections 2026-02-13T01:26:37.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.447+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/4138756613 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8aa4115410 0x7f8aa4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.447+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/4138756613 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8aa410fbf0 0x7f8aa4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.447+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/4138756613 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa410f200 0x7f8aa410f5d0 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=4590992742716078026 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.447+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/4138756613 >> 10.20.193.40:0/4138756613 conn(0x7f8aa40ecb00 msgr2=0x7f8aa410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:37.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.447+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/4138756613 shutdown_connections 2026-02-13T01:26:37.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.447+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/4138756613 wait complete. 2026-02-13T01:26:37.451 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.448+0000 7f8aac02c6c0 1 Processor -- start 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.448+0000 7f8aac02c6c0 1 -- start start 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.448+0000 7f8aac02c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8aa410f200 0x7f8aa411ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.448+0000 7f8aac02c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa4115410 0x7f8aa411b0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.448+0000 7f8aac02c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8aa4120470 0x7f8aa4120910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.448+0000 7f8aac02c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4120e80 con 0x7f8aa4115410 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.448+0000 7f8aac02c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4120ff0 con 0x7f8aa4120470 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.448+0000 7f8aac02c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa41211b0 con 0x7f8aa410f200 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa95a06c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa4115410 0x7f8aa411b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa95a06c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa4115410 0x7f8aa411b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:56470/0 (socket says 10.20.193.40:56470) 2026-02-13T01:26:37.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa95a06c0 1 -- 10.20.193.40:0/2068035970 learned_addr learned my addr 10.20.193.40:0/2068035970 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa9da16c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8aa410f200 0x7f8aa411ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aaa5a26c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8aa4120470 0x7f8aa4120910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa95a06c0 1 -- 10.20.193.40:0/2068035970 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8aa410f200 msgr2=0x7f8aa411ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa95a06c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8aa410f200 0x7f8aa411ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa95a06c0 1 -- 10.20.193.40:0/2068035970 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8aa4120470 msgr2=0x7f8aa4120910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa95a06c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8aa4120470 0x7f8aa4120910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa95a06c0 1 -- 10.20.193.40:0/2068035970 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a94009590 con 0x7f8aa4115410 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aa95a06c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa4115410 0x7f8aa411b0b0 secure :-1 s=READY pgs=312 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a9800b800 tx=0x7f8a9800bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8a92ffd6c0 1 -- 10.20.193.40:0/2068035970 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a98004a80 con 0x7f8aa4115410 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8a92ffd6c0 1 -- 10.20.193.40:0/2068035970 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8a98009070 con 0x7f8aa4115410 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8a92ffd6c0 1 -- 10.20.193.40:0/2068035970 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a980071c0 con 0x7f8aa4115410 2026-02-13T01:26:37.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa4161660 con 0x7f8aa4115410 2026-02-13T01:26:37.454 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.449+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa4161af0 con 0x7f8aa4115410 2026-02-13T01:26:37.454 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.450+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa41104d0 con 0x7f8aa4115410 2026-02-13T01:26:37.454 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.452+0000 7f8a92ffd6c0 1 -- 10.20.193.40:0/2068035970 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8a98004060 con 0x7f8aa4115410 2026-02-13T01:26:37.455 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.454+0000 7f8a92ffd6c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8a800b56d0 0x7f8a800d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:37.456 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.454+0000 7f8a92ffd6c0 1 -- 10.20.193.40:0/2068035970 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f8a980e3ae0 con 0x7f8aa4115410 2026-02-13T01:26:37.456 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.454+0000 7f8aa9da16c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8a800b56d0 0x7f8a800d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:37.456 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.454+0000 7f8a92ffd6c0 1 -- 10.20.193.40:0/2068035970 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8a9811c5e0 con 0x7f8aa4115410 2026-02-13T01:26:37.456 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.455+0000 7f8aa9da16c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8a800b56d0 0x7f8a800d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a94005b40 tx=0x7f8a940023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:37.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.578+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8aa410fbf0 con 0x7f8aa4115410 2026-02-13T01:26:37.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.578+0000 7f8a92ffd6c0 1 -- 10.20.193.40:0/2068035970 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8a980a6480 con 0x7f8aa4115410 2026-02-13T01:26:37.580 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:37.580 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:37.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8a800b56d0 msgr2=0x7f8a800d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:37.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8a800b56d0 0x7f8a800d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a94005b40 tx=0x7f8a940023a0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa4115410 msgr2=0x7f8aa411b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:37.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa4115410 0x7f8aa411b0b0 secure :-1 s=READY pgs=312 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a9800b800 tx=0x7f8a9800bcd0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 shutdown_connections 2026-02-13T01:26:37.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8a800b56d0 0x7f8a800d5b80 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8aa4120470 0x7f8aa4120910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8aa4115410 0x7f8aa411b0b0 unknown :-1 s=CLOSED pgs=312 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 --2- 10.20.193.40:0/2068035970 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8aa410f200 0x7f8aa411ab70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:37.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 >> 10.20.193.40:0/2068035970 conn(0x7f8aa40ecb00 msgr2=0x7f8aa410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:37.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.579+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 shutdown_connections 2026-02-13T01:26:37.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:37.580+0000 7f8aac02c6c0 1 -- 10.20.193.40:0/2068035970 wait complete. 2026-02-13T01:26:37.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:37 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2068035970' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:38.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:37 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2068035970' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:38.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:37 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2068035970' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:39.142 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:38 trial055 ceph-mon[27509]: pgmap v264: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:39.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:38 trial040 ceph-mon[23046]: pgmap v264: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:39.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:38 trial118 ceph-mon[27812]: pgmap v264: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:40.684 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:40.869 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:41.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.060+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/1235848998 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10fbf0 msgr2=0x7f71dc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:41.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.060+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/1235848998 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10fbf0 0x7f71dc114c30 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=3120905869144124861 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d00099a0 tx=0x7f71d002ed00 comp rx=0 tx=0).stop 2026-02-13T01:26:41.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.060+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/1235848998 shutdown_connections 2026-02-13T01:26:41.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.060+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/1235848998 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f71dc115410 0x7f71dc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.060+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/1235848998 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10fbf0 0x7f71dc114c30 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=3120905869144124861 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.060+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/1235848998 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f71dc10f200 0x7f71dc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.060+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/1235848998 >> 10.20.193.40:0/1235848998 conn(0x7f71dc0ecb00 msgr2=0x7f71dc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:41.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.060+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/1235848998 shutdown_connections 2026-02-13T01:26:41.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.060+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/1235848998 wait complete. 2026-02-13T01:26:41.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e3d4c6c0 1 Processor -- start 2026-02-13T01:26:41.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e3d4c6c0 1 -- start start 2026-02-13T01:26:41.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e3d4c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10f200 0x7f71dc11cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e3d4c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f71dc115410 0x7f71dc11d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e3d4c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f71dc1228b0 0x7f71dc122d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e3d4c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc1232c0 con 0x7f71dc10f200 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e3d4c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc123430 con 0x7f71dc115410 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e3d4c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc1235f0 con 0x7f71dc1228b0 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e1ac16c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10f200 0x7f71dc11cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e12c06c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f71dc115410 0x7f71dc11d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e1ac16c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10f200 0x7f71dc11cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:46264/0 (socket says 10.20.193.40:46264) 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e1ac16c0 1 -- 10.20.193.40:0/2209678468 learned_addr learned my addr 10.20.193.40:0/2209678468 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:41.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e12c06c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f71dc115410 0x7f71dc11d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:54876/0 (socket says 10.20.193.40:54876) 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.061+0000 7f71e22c26c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f71dc1228b0 0x7f71dc122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71e1ac16c0 1 -- 10.20.193.40:0/2209678468 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f71dc1228b0 msgr2=0x7f71dc122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71e1ac16c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f71dc1228b0 0x7f71dc122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71e1ac16c0 1 -- 10.20.193.40:0/2209678468 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f71dc115410 msgr2=0x7f71dc11d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71e1ac16c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f71dc115410 0x7f71dc11d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71e1ac16c0 1 -- 10.20.193.40:0/2209678468 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d0009590 con 0x7f71dc10f200 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71e1ac16c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10f200 0x7f71dc11cfb0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71cc005dc0 tx=0x7f71cc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71caffd6c0 1 -- 10.20.193.40:0/2209678468 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71cc004250 con 0x7f71dc10f200 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71caffd6c0 1 -- 10.20.193.40:0/2209678468 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f71cc009070 con 0x7f71dc10f200 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71dc163aa0 con 0x7f71dc10f200 2026-02-13T01:26:41.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71caffd6c0 1 -- 10.20.193.40:0/2209678468 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71cc0071c0 con 0x7f71dc10f200 2026-02-13T01:26:41.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.062+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71dc163f30 con 0x7f71dc10f200 2026-02-13T01:26:41.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.063+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71dc1104d0 con 0x7f71dc10f200 2026-02-13T01:26:41.068 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.065+0000 7f71caffd6c0 1 -- 10.20.193.40:0/2209678468 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f71cc0043b0 con 0x7f71dc10f200 2026-02-13T01:26:41.068 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.066+0000 7f71caffd6c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f71b80b57a0 0x7f71b80d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:41.068 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.066+0000 7f71caffd6c0 1 -- 10.20.193.40:0/2209678468 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f71cc0e3a30 con 0x7f71dc10f200 2026-02-13T01:26:41.068 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.066+0000 7f71e12c06c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f71b80b57a0 0x7f71b80d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:41.068 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.066+0000 7f71caffd6c0 1 -- 10.20.193.40:0/2209678468 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f71cc11c5e0 con 0x7f71dc10f200 2026-02-13T01:26:41.068 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.067+0000 7f71e12c06c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f71b80b57a0 0x7f71b80d5c50 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71dc123940 tx=0x7f71d00023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:41.193 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.192+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f71dc10f5d0 con 0x7f71dc10f200 2026-02-13T01:26:41.194 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.192+0000 7f71caffd6c0 1 -- 10.20.193.40:0/2209678468 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f71cc0a63d0 con 0x7f71dc10f200 2026-02-13T01:26:41.194 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:41.194 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:41.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f71b80b57a0 msgr2=0x7f71b80d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:41.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f71b80b57a0 0x7f71b80d5c50 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71dc123940 tx=0x7f71d00023a0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10f200 msgr2=0x7f71dc11cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:41.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10f200 0x7f71dc11cfb0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71cc005dc0 tx=0x7f71cc00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 shutdown_connections 2026-02-13T01:26:41.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f71b80b57a0 0x7f71b80d5c50 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f71dc1228b0 0x7f71dc122d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f71dc115410 0x7f71dc11d4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 --2- 10.20.193.40:0/2209678468 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f71dc10f200 0x7f71dc11cfb0 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:41.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.193+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 >> 10.20.193.40:0/2209678468 conn(0x7f71dc0ecb00 msgr2=0x7f71dc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:41.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.194+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 shutdown_connections 2026-02-13T01:26:41.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:41.194+0000 7f71e3d4c6c0 1 -- 10.20.193.40:0/2209678468 wait complete. 2026-02-13T01:26:41.254 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:41 trial040 ceph-mon[23046]: pgmap v265: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:41.254 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:41 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2209678468' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:41.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:41 trial118 ceph-mon[27812]: pgmap v265: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:41.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:41 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2209678468' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:41.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:41 trial055 ceph-mon[27509]: pgmap v265: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:41.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:41 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2209678468' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:43.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:43 trial040 ceph-mon[23046]: pgmap v266: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:43.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:43 trial118 ceph-mon[27812]: pgmap v266: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:43.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:43 trial055 ceph-mon[27509]: pgmap v266: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:44.300 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:44.485 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:44.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.675+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/2924741023 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f011b3f0 msgr2=0x7fb9f011b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:44.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.675+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/2924741023 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f011b3f0 0x7fb9f011b7c0 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=1742415018129333470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9e4009970 tx=0x7fb9e402ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:44.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.675+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/2924741023 shutdown_connections 2026-02-13T01:26:44.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.675+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/2924741023 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb9f01199a0 0x7fb9f0116df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:44.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.675+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/2924741023 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb9f0118f30 0x7fb9f0119380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:44.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.675+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/2924741023 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f011b3f0 0x7fb9f011b7c0 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=1742415018129333470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:44.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.675+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/2924741023 >> 10.20.193.40:0/2924741023 conn(0x7fb9f005b290 msgr2=0x7fb9f005b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:44.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.675+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/2924741023 shutdown_connections 2026-02-13T01:26:44.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.676+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/2924741023 wait complete. 2026-02-13T01:26:44.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.676+0000 7fb9f51bd6c0 1 Processor -- start 2026-02-13T01:26:44.680 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.676+0000 7fb9f51bd6c0 1 -- start start 2026-02-13T01:26:44.680 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.676+0000 7fb9f51bd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f0118f30 0x7fb9f00fda40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.676+0000 7fb9f51bd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb9f01199a0 0x7fb9f00fdf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9f51bd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb9f011b3f0 0x7fb9f0103340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9f51bd6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f0103990 con 0x7fb9f0118f30 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9f51bd6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f0103b00 con 0x7fb9f011b3f0 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9f51bd6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f0103cc0 con 0x7fb9f01199a0 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9eed766c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f0118f30 0x7fb9f00fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9eed766c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f0118f30 0x7fb9f00fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:46284/0 (socket says 10.20.193.40:46284) 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9eed766c0 1 -- 10.20.193.40:0/1523183401 learned_addr learned my addr 10.20.193.40:0/1523183401 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9ef5776c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb9f011b3f0 0x7fb9f0103340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:44.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9ee5756c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb9f01199a0 0x7fb9f00fdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9eed766c0 1 -- 10.20.193.40:0/1523183401 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb9f01199a0 msgr2=0x7fb9f00fdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9eed766c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb9f01199a0 0x7fb9f00fdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9eed766c0 1 -- 10.20.193.40:0/1523183401 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb9f011b3f0 msgr2=0x7fb9f0103340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9eed766c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb9f011b3f0 0x7fb9f0103340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9eed766c0 1 -- 10.20.193.40:0/1523183401 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e4009590 con 0x7fb9f0118f30 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9eed766c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f0118f30 0x7fb9f00fda40 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9e4005ae0 tx=0x7fb9e402f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9c7fff6c0 1 -- 10.20.193.40:0/1523183401 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9e402fa00 con 0x7fb9f0118f30 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9c7fff6c0 1 -- 10.20.193.40:0/1523183401 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb9e402fdb0 con 0x7fb9f0118f30 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9c7fff6c0 1 -- 10.20.193.40:0/1523183401 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9e40319f0 con 0x7fb9f0118f30 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f0103f40 con 0x7fb9f0118f30 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.677+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f01041c0 con 0x7fb9f0118f30 2026-02-13T01:26:44.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.678+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f005e670 con 0x7fb9f0118f30 2026-02-13T01:26:44.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.680+0000 7fb9c7fff6c0 1 -- 10.20.193.40:0/1523183401 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb9e40026b0 con 0x7fb9f0118f30 2026-02-13T01:26:44.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.682+0000 7fb9c7fff6c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb9c00b56d0 0x7fb9c00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:44.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.682+0000 7fb9c7fff6c0 1 -- 10.20.193.40:0/1523183401 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fb9e4107c80 con 0x7fb9f0118f30 2026-02-13T01:26:44.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.682+0000 7fb9c7fff6c0 1 -- 10.20.193.40:0/1523183401 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb9e4108100 con 0x7fb9f0118f30 2026-02-13T01:26:44.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.682+0000 7fb9ee5756c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb9c00b56d0 0x7fb9c00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:44.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.682+0000 7fb9ee5756c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb9c00b56d0 0x7fb9c00d5b80 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9f01043d0 tx=0x7fb9d8009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:44.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.809+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9f0186160 con 0x7fb9f0118f30 2026-02-13T01:26:44.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.809+0000 7fb9c7fff6c0 1 -- 10.20.193.40:0/1523183401 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb9e40ca620 con 0x7fb9f0118f30 2026-02-13T01:26:44.811 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:44.811 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:44.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb9c00b56d0 msgr2=0x7fb9c00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:44.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb9c00b56d0 0x7fb9c00d5b80 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9f01043d0 tx=0x7fb9d8009260 comp rx=0 tx=0).stop 2026-02-13T01:26:44.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f0118f30 msgr2=0x7fb9f00fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:44.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f0118f30 0x7fb9f00fda40 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9e4005ae0 tx=0x7fb9e402f600 comp rx=0 tx=0).stop 2026-02-13T01:26:44.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 shutdown_connections 2026-02-13T01:26:44.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb9c00b56d0 0x7fb9c00d5b80 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:44.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb9f011b3f0 0x7fb9f0103340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:44.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb9f01199a0 0x7fb9f00fdf80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:44.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 --2- 10.20.193.40:0/1523183401 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb9f0118f30 0x7fb9f00fda40 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:44.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 >> 10.20.193.40:0/1523183401 conn(0x7fb9f005b290 msgr2=0x7fb9f00f4200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:44.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 shutdown_connections 2026-02-13T01:26:44.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:44.811+0000 7fb9f51bd6c0 1 -- 10.20.193.40:0/1523183401 wait complete. 2026-02-13T01:26:45.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:45 trial118 ceph-mon[27812]: pgmap v267: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:45.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:45 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1523183401' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:45.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:45 trial055 ceph-mon[27509]: pgmap v267: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:45.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:45 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1523183401' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:45.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:45 trial040 ceph-mon[23046]: pgmap v267: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:45.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:45 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1523183401' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:47.503 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:47 trial118 ceph-mon[27812]: pgmap v268: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:47.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:47 trial055 ceph-mon[27509]: pgmap v268: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:47.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:47 trial040 ceph-mon[23046]: pgmap v268: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:47.915 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:48.098 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:48.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.303+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/1622783273 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 msgr2=0x7fbf3010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:48.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.303+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/1622783273 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 0x7fbf3010f430 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=14791669429336357201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf240099a0 tx=0x7fbf2402ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:48.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.303+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/1622783273 shutdown_connections 2026-02-13T01:26:48.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.303+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/1622783273 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf30115270 0x7fbf30175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:48.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.303+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/1622783273 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf3010fa50 0x7fbf30114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:48.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.303+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/1622783273 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 0x7fbf3010f430 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=14791669429336357201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:48.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.303+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/1622783273 >> 10.20.193.40:0/1622783273 conn(0x7fbf300ec980 msgr2=0x7fbf3010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:48.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.303+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/1622783273 shutdown_connections 2026-02-13T01:26:48.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.304+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/1622783273 wait complete. 2026-02-13T01:26:48.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2ffff6c0 1 Processor -- start 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2ffff6c0 1 -- start start 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2ffff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 0x7fbf3011ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2ffff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf30115270 0x7fbf3011d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2ffff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf30122700 0x7fbf30122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2ffff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30123110 con 0x7fbf3010f060 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2ffff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30123280 con 0x7fbf30115270 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2ffff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30123440 con 0x7fbf30122700 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2e7fc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf30115270 0x7fbf3011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2effd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 0x7fbf3011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:48.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2effd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 0x7fbf3011ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:46300/0 (socket says 10.20.193.40:46300) 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.305+0000 7fbf2effd6c0 1 -- 10.20.193.40:0/2774167371 learned_addr learned my addr 10.20.193.40:0/2774167371 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2f7fe6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf30122700 0x7fbf30122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2effd6c0 1 -- 10.20.193.40:0/2774167371 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf30122700 msgr2=0x7fbf30122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2effd6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf30122700 0x7fbf30122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2effd6c0 1 -- 10.20.193.40:0/2774167371 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf30115270 msgr2=0x7fbf3011d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2effd6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf30115270 0x7fbf3011d340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2effd6c0 1 -- 10.20.193.40:0/2774167371 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf24009590 con 0x7fbf3010f060 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2f7fe6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf30122700 0x7fbf30122ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2effd6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 0x7fbf3011ce00 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf240098c0 tx=0x7fbf2402f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf0ffff6c0 1 -- 10.20.193.40:0/2774167371 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf2402fdb0 con 0x7fbf3010f060 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf0ffff6c0 1 -- 10.20.193.40:0/2774167371 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbf24002be0 con 0x7fbf3010f060 2026-02-13T01:26:48.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf30163890 con 0x7fbf3010f060 2026-02-13T01:26:48.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf0ffff6c0 1 -- 10.20.193.40:0/2774167371 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf240073f0 con 0x7fbf3010f060 2026-02-13T01:26:48.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.306+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf30163cc0 con 0x7fbf3010f060 2026-02-13T01:26:48.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.307+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf30110330 con 0x7fbf3010f060 2026-02-13T01:26:48.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.309+0000 7fbf0ffff6c0 1 -- 10.20.193.40:0/2774167371 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fbf240310c0 con 0x7fbf3010f060 2026-02-13T01:26:48.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.311+0000 7fbf0ffff6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbf040b5650 0x7fbf040d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:48.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.311+0000 7fbf0ffff6c0 1 -- 10.20.193.40:0/2774167371 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fbf24107e80 con 0x7fbf3010f060 2026-02-13T01:26:48.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.311+0000 7fbf2e7fc6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbf040b5650 0x7fbf040d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:48.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.311+0000 7fbf0ffff6c0 1 -- 10.20.193.40:0/2774167371 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbf24108300 con 0x7fbf3010f060 2026-02-13T01:26:48.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.311+0000 7fbf2e7fc6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbf040b5650 0x7fbf040d5b00 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf30123790 tx=0x7fbf18009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:48.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.435+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbf3010fa50 con 0x7fbf3010f060 2026-02-13T01:26:48.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.435+0000 7fbf0ffff6c0 1 -- 10.20.193.40:0/2774167371 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbf240ca820 con 0x7fbf3010f060 2026-02-13T01:26:48.437 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:48.437 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:48.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbf040b5650 msgr2=0x7fbf040d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:48.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbf040b5650 0x7fbf040d5b00 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf30123790 tx=0x7fbf18009260 comp rx=0 tx=0).stop 2026-02-13T01:26:48.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 msgr2=0x7fbf3011ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:48.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 0x7fbf3011ce00 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf240098c0 tx=0x7fbf2402f580 comp rx=0 tx=0).stop 2026-02-13T01:26:48.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 shutdown_connections 2026-02-13T01:26:48.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbf040b5650 0x7fbf040d5b00 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:48.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf30122700 0x7fbf30122ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:48.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf30115270 0x7fbf3011d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:48.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 --2- 10.20.193.40:0/2774167371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf3010f060 0x7fbf3011ce00 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:48.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.436+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 >> 10.20.193.40:0/2774167371 conn(0x7fbf300ec980 msgr2=0x7fbf3010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:48.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.437+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 shutdown_connections 2026-02-13T01:26:48.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:48.437+0000 7fbf2ffff6c0 1 -- 10.20.193.40:0/2774167371 wait complete. 2026-02-13T01:26:49.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:49 trial055 ceph-mon[27509]: pgmap v269: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:49.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:49 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2774167371' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:49.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:49 trial040 ceph-mon[23046]: pgmap v269: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:49.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:49 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2774167371' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:49.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:49 trial118 ceph-mon[27812]: pgmap v269: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:49.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:49 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2774167371' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:51.542 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:51.593 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:51 trial040 ceph-mon[23046]: pgmap v270: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:51.728 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:51.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:51 trial055 ceph-mon[27509]: pgmap v270: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:51.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:51 trial118 ceph-mon[27812]: pgmap v270: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.917+0000 7f0e40b406c0 1 -- 10.20.193.40:0/1368251886 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0e3c114190 msgr2=0x7f0e3c119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.917+0000 7f0e40b406c0 1 --2- 10.20.193.40:0/1368251886 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0e3c114190 0x7f0e3c119140 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=9188461290228584520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e24009970 tx=0x7f0e2402ed10 comp rx=0 tx=0).stop 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.917+0000 7f0e40b406c0 1 -- 10.20.193.40:0/1368251886 shutdown_connections 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.917+0000 7f0e40b406c0 1 --2- 10.20.193.40:0/1368251886 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0e3c1198f0 0x7f0e3c17a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.917+0000 7f0e40b406c0 1 --2- 10.20.193.40:0/1368251886 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0e3c114190 0x7f0e3c119140 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=9188461290228584520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.917+0000 7f0e40b406c0 1 --2- 10.20.193.40:0/1368251886 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0e3c1137a0 0x7f0e3c113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.917+0000 7f0e40b406c0 1 -- 10.20.193.40:0/1368251886 >> 10.20.193.40:0/1368251886 conn(0x7f0e3c060760 msgr2=0x7f0e3c060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.917+0000 7f0e40b406c0 1 -- 10.20.193.40:0/1368251886 shutdown_connections 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.917+0000 7f0e40b406c0 1 -- 10.20.193.40:0/1368251886 wait complete. 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.918+0000 7f0e40b406c0 1 Processor -- start 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.918+0000 7f0e40b406c0 1 -- start start 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e40b406c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0e3c1137a0 0x7f0e3c121550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e40b406c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0e3c1198f0 0x7f0e3c121a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e40b406c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0e3c126e50 0x7f0e3c1272f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e40b406c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c127860 con 0x7f0e3c1198f0 2026-02-13T01:26:51.919 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e40b406c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c1279d0 con 0x7f0e3c1137a0 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e40b406c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c127b90 con 0x7f0e3c126e50 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3a5756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0e3c1137a0 0x7f0e3c121550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3a5756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0e3c1137a0 0x7f0e3c121550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:38170/0 (socket says 10.20.193.40:38170) 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3a5756c0 1 -- 10.20.193.40:0/1403984512 learned_addr learned my addr 10.20.193.40:0/1403984512 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3ad766c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0e3c126e50 0x7f0e3c1272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e39d746c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0e3c1198f0 0x7f0e3c121a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3a5756c0 1 -- 10.20.193.40:0/1403984512 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0e3c126e50 msgr2=0x7f0e3c1272f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3a5756c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0e3c126e50 0x7f0e3c1272f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3a5756c0 1 -- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0e3c1198f0 msgr2=0x7f0e3c121a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3a5756c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0e3c1198f0 0x7f0e3c121a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3a5756c0 1 -- 10.20.193.40:0/1403984512 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e24009590 con 0x7f0e3c1137a0 2026-02-13T01:26:51.920 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e3a5756c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0e3c1137a0 0x7f0e3c121550 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e30005dc0 tx=0x7f0e3000bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:51.921 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e237fe6c0 1 -- 10.20.193.40:0/1403984512 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e30004250 con 0x7f0e3c1137a0 2026-02-13T01:26:51.921 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.919+0000 7f0e237fe6c0 1 -- 10.20.193.40:0/1403984512 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0e30009070 con 0x7f0e3c1137a0 2026-02-13T01:26:51.921 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.920+0000 7f0e40b406c0 1 -- 10.20.193.40:0/1403984512 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3c168040 con 0x7f0e3c1137a0 2026-02-13T01:26:51.921 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.920+0000 7f0e40b406c0 1 -- 10.20.193.40:0/1403984512 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3c1684d0 con 0x7f0e3c1137a0 2026-02-13T01:26:51.921 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.920+0000 7f0e237fe6c0 1 -- 10.20.193.40:0/1403984512 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e300071c0 con 0x7f0e3c1137a0 2026-02-13T01:26:51.921 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.920+0000 7f0e217fa6c0 1 -- 10.20.193.40:0/1403984512 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e3c1149e0 con 0x7f0e3c1137a0 2026-02-13T01:26:51.923 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.922+0000 7f0e237fe6c0 1 -- 10.20.193.40:0/1403984512 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0e300043b0 con 0x7f0e3c1137a0 2026-02-13T01:26:51.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.924+0000 7f0e237fe6c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0e140b5650 0x7f0e140d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:51.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.924+0000 7f0e39d746c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0e140b5650 0x7f0e140d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:51.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.924+0000 7f0e237fe6c0 1 -- 10.20.193.40:0/1403984512 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f0e300e3b20 con 0x7f0e3c1137a0 2026-02-13T01:26:51.925 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.924+0000 7f0e237fe6c0 1 -- 10.20.193.40:0/1403984512 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0e3011c5e0 con 0x7f0e3c1137a0 2026-02-13T01:26:51.926 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:51.925+0000 7f0e39d746c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0e140b5650 0x7f0e140d5b00 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c127ee0 tx=0x7f0e240023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:52.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.048+0000 7f0e217fa6c0 1 -- 10.20.193.40:0/1403984512 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0e3c113b70 con 0x7f0e3c1137a0 2026-02-13T01:26:52.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.049+0000 7f0e237fe6c0 1 -- 10.20.193.40:0/1403984512 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0e300a64c0 con 0x7f0e3c1137a0 2026-02-13T01:26:52.050 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:52.051 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:52.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 -- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0e140b5650 msgr2=0x7f0e140d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:52.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0e140b5650 0x7f0e140d5b00 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e3c127ee0 tx=0x7f0e240023a0 comp rx=0 tx=0).stop 2026-02-13T01:26:52.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 -- 10.20.193.40:0/1403984512 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0e3c1137a0 msgr2=0x7f0e3c121550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:52.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0e3c1137a0 0x7f0e3c121550 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e30005dc0 tx=0x7f0e3000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:26:52.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 -- 10.20.193.40:0/1403984512 shutdown_connections 2026-02-13T01:26:52.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0e140b5650 0x7f0e140d5b00 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:52.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0e3c126e50 0x7f0e3c1272f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:52.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0e3c1198f0 0x7f0e3c121a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:52.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 --2- 10.20.193.40:0/1403984512 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0e3c1137a0 0x7f0e3c121550 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:52.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 -- 10.20.193.40:0/1403984512 >> 10.20.193.40:0/1403984512 conn(0x7f0e3c060760 msgr2=0x7f0e3c117740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:52.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 -- 10.20.193.40:0/1403984512 shutdown_connections 2026-02-13T01:26:52.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:52.050+0000 7f0e217fa6c0 1 -- 10.20.193.40:0/1403984512 wait complete. 2026-02-13T01:26:52.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:52 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1403984512' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:52.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:52 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1403984512' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:52.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:52 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1403984512' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:53.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:53 trial055 ceph-mon[27509]: pgmap v271: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:53.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:53 trial040 ceph-mon[23046]: pgmap v271: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:53.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:53 trial118 ceph-mon[27812]: pgmap v271: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:55.157 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:55.344 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:55.461 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:55 trial040 ceph-mon[23046]: pgmap v272: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:55.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.551+0000 7f46d49a76c0 1 -- 10.20.193.40:0/2783131825 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46d0159910 msgr2=0x7f46d0179cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:55.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.551+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/2783131825 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46d0159910 0x7f46d0179cf0 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=4543083285369476511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c000aa40 tx=0x7f46c002fdf0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.552+0000 7f46d49a76c0 1 -- 10.20.193.40:0/2783131825 shutdown_connections 2026-02-13T01:26:55.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.552+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/2783131825 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46d0159910 0x7f46d0179cf0 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=4543083285369476511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.554 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.552+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/2783131825 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46d0060ce0 0x7f46d0061110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.552+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/2783131825 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46d00622d0 0x7f46d00607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.552+0000 7f46d49a76c0 1 -- 10.20.193.40:0/2783131825 >> 10.20.193.40:0/2783131825 conn(0x7f46d00ea6d0 msgr2=0x7f46d010aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:55.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.552+0000 7f46d49a76c0 1 -- 10.20.193.40:0/2783131825 shutdown_connections 2026-02-13T01:26:55.555 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.552+0000 7f46d49a76c0 1 -- 10.20.193.40:0/2783131825 wait complete. 2026-02-13T01:26:55.556 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.552+0000 7f46d49a76c0 1 Processor -- start 2026-02-13T01:26:55.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.552+0000 7f46d49a76c0 1 -- start start 2026-02-13T01:26:55.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46d49a76c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46d0060ce0 0x7f46d0161000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:55.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46d49a76c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46d00622d0 0x7f46d0161540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:55.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46d49a76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46d0159910 0x7f46d0166900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:55.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46d49a76c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f46d0166f50 con 0x7f46d0159910 2026-02-13T01:26:55.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46d49a76c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f46d01670c0 con 0x7f46d00622d0 2026-02-13T01:26:55.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46d49a76c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f46d0167280 con 0x7f46d0060ce0 2026-02-13T01:26:55.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46ce5756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46d00622d0 0x7f46d0161540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:55.557 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46cf5776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46d0159910 0x7f46d0166900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46ce5756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46d00622d0 0x7f46d0161540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:38194/0 (socket says 10.20.193.40:38194) 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46ce5756c0 1 -- 10.20.193.40:0/61669919 learned_addr learned my addr 10.20.193.40:0/61669919 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46ced766c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46d0060ce0 0x7f46d0161000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46cf5776c0 1 -- 10.20.193.40:0/61669919 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46d0060ce0 msgr2=0x7f46d0161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46cf5776c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46d0060ce0 0x7f46d0161000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46cf5776c0 1 -- 10.20.193.40:0/61669919 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46d00622d0 msgr2=0x7f46d0161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46cf5776c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46d00622d0 0x7f46d0161540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46cf5776c0 1 -- 10.20.193.40:0/61669919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c000a660 con 0x7f46d0159910 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.553+0000 7f46cf5776c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46d0159910 0x7f46d0166900 secure :-1 s=READY pgs=321 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c0030300 tx=0x7f46c0030b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.554+0000 7f46affff6c0 1 -- 10.20.193.40:0/61669919 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46c00054a0 con 0x7f46d0159910 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.554+0000 7f46affff6c0 1 -- 10.20.193.40:0/61669919 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f46c0003d40 con 0x7f46d0159910 2026-02-13T01:26:55.558 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.554+0000 7f46affff6c0 1 -- 10.20.193.40:0/61669919 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46c00322b0 con 0x7f46d0159910 2026-02-13T01:26:55.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.554+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d0167500 con 0x7f46d0159910 2026-02-13T01:26:55.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.554+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d0167780 con 0x7f46d0159910 2026-02-13T01:26:55.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.554+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d0061cb0 con 0x7f46d0159910 2026-02-13T01:26:55.559 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.557+0000 7f46affff6c0 1 -- 10.20.193.40:0/61669919 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f46c0003a20 con 0x7f46d0159910 2026-02-13T01:26:55.561 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.558+0000 7f46affff6c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46a00b56d0 0x7f46a00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:55.561 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.558+0000 7f46affff6c0 1 -- 10.20.193.40:0/61669919 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f46c0108fc0 con 0x7f46d0159910 2026-02-13T01:26:55.561 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.559+0000 7f46affff6c0 1 -- 10.20.193.40:0/61669919 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f46c0109440 con 0x7f46d0159910 2026-02-13T01:26:55.561 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.559+0000 7f46ced766c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46a00b56d0 0x7f46a00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:55.561 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.559+0000 7f46ced766c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46a00b56d0 0x7f46a00d5b80 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c4004750 tx=0x7f46c4009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:55.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.683+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f46d0061110 con 0x7f46d0159910 2026-02-13T01:26:55.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.684+0000 7f46affff6c0 1 -- 10.20.193.40:0/61669919 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f46c00cb960 con 0x7f46d0159910 2026-02-13T01:26:55.685 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:55.685 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46a00b56d0 msgr2=0x7f46a00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46a00b56d0 0x7f46a00d5b80 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c4004750 tx=0x7f46c4009390 comp rx=0 tx=0).stop 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46d0159910 msgr2=0x7f46d0166900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46d0159910 0x7f46d0166900 secure :-1 s=READY pgs=321 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c0030300 tx=0x7f46c0030b40 comp rx=0 tx=0).stop 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 shutdown_connections 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f46a00b56d0 0x7f46a00d5b80 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f46d0159910 0x7f46d0166900 unknown :-1 s=CLOSED pgs=321 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f46d00622d0 0x7f46d0161540 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 --2- 10.20.193.40:0/61669919 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f46d0060ce0 0x7f46d0161000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:55.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 >> 10.20.193.40:0/61669919 conn(0x7f46d00ea6d0 msgr2=0x7f46d010aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:55.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 shutdown_connections 2026-02-13T01:26:55.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:55.685+0000 7f46d49a76c0 1 -- 10.20.193.40:0/61669919 wait complete. 2026-02-13T01:26:55.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:55 trial055 ceph-mon[27509]: pgmap v272: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:55.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:55 trial118 ceph-mon[27812]: pgmap v272: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:56.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:56 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/61669919' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:56.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:56 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:26:56.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:56 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/61669919' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:56.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:56 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:26:56.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:56 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/61669919' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:56.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:56 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:26:57.524 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:57 trial118 ceph-mon[27812]: pgmap v273: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:57.524 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:57.524 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:26:57.525 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:26:57.525 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:26:57.525 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:26:57.525 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:57.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:57 trial055 ceph-mon[27509]: pgmap v273: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:26:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:26:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:26:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:26:57.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:57 trial040 ceph-mon[23046]: pgmap v273: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:26:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:26:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:26:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:26:57.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:58.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:58 trial055 ceph-mon[27509]: pgmap v274: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:26:58.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:58 trial055 ceph-mon[27509]: pgmap v275: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:26:58.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:58 trial040 ceph-mon[23046]: pgmap v274: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:26:58.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:58 trial040 ceph-mon[23046]: pgmap v275: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:26:58.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:58 trial118 ceph-mon[27812]: pgmap v274: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:26:58.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:58 trial118 ceph-mon[27812]: pgmap v275: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:26:58.821 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:59.005 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:26:59.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 -- 10.20.193.40:0/48103972 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 msgr2=0x7f445c173990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:59.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 --2- 10.20.193.40:0/48103972 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 0x7f445c173990 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=13122463036664334795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f445800aa70 tx=0x7f445802fde0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 -- 10.20.193.40:0/48103972 shutdown_connections 2026-02-13T01:26:59.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 --2- 10.20.193.40:0/48103972 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 0x7f445c173990 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=13122463036664334795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 --2- 10.20.193.40:0/48103972 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f445c10d7d0 0x7f445c112810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 --2- 10.20.193.40:0/48103972 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f445c10cde0 0x7f445c10d1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 -- 10.20.193.40:0/48103972 >> 10.20.193.40:0/48103972 conn(0x7f445c0ea6a0 msgr2=0x7f445c10aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:59.204 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 -- 10.20.193.40:0/48103972 shutdown_connections 2026-02-13T01:26:59.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 -- 10.20.193.40:0/48103972 wait complete. 2026-02-13T01:26:59.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.202+0000 7f446264b6c0 1 Processor -- start 2026-02-13T01:26:59.205 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f446264b6c0 1 -- start start 2026-02-13T01:26:59.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f446264b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f445c10cde0 0x7f445c0f46e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:59.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f446264b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 0x7f445c173890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:59.206 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f446264b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f445c0f4d10 0x7f445c0f9fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f446264b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0f5400 con 0x7f445c112ff0 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f446264b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0fa520 con 0x7f445c10cde0 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f446264b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0fa6e0 con 0x7f445c0f4d10 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f4460e486c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 0x7f445c173890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f4460e486c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 0x7f445c173890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:35990/0 (socket says 10.20.193.40:35990) 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f4460e486c0 1 -- 10.20.193.40:0/1467689854 learned_addr learned my addr 10.20.193.40:0/1467689854 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f4461e4a6c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f445c0f4d10 0x7f445c0f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f44616496c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f445c10cde0 0x7f445c0f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f4460e486c0 1 -- 10.20.193.40:0/1467689854 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f445c0f4d10 msgr2=0x7f445c0f9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f4460e486c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f445c0f4d10 0x7f445c0f9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f4460e486c0 1 -- 10.20.193.40:0/1467689854 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f445c10cde0 msgr2=0x7f445c0f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:59.207 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f4460e486c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f445c10cde0 0x7f445c0f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f4460e486c0 1 -- 10.20.193.40:0/1467689854 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445800a660 con 0x7f445c112ff0 2026-02-13T01:26:59.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.203+0000 7f44616496c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f445c10cde0 0x7f445c0f46e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:26:59.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.204+0000 7f4460e486c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 0x7f445c173890 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4450005dc0 tx=0x7f445000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:59.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.204+0000 7f444a7fc6c0 1 -- 10.20.193.40:0/1467689854 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4450004250 con 0x7f445c112ff0 2026-02-13T01:26:59.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.204+0000 7f444a7fc6c0 1 -- 10.20.193.40:0/1467689854 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4450009070 con 0x7f445c112ff0 2026-02-13T01:26:59.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.204+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c0fa9c0 con 0x7f445c112ff0 2026-02-13T01:26:59.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.204+0000 7f444a7fc6c0 1 -- 10.20.193.40:0/1467689854 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44500071c0 con 0x7f445c112ff0 2026-02-13T01:26:59.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.204+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c0fb150 con 0x7f445c112ff0 2026-02-13T01:26:59.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.205+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c10e0b0 con 0x7f445c112ff0 2026-02-13T01:26:59.209 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.207+0000 7f444a7fc6c0 1 -- 10.20.193.40:0/1467689854 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f44500043b0 con 0x7f445c112ff0 2026-02-13T01:26:59.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.209+0000 7f444a7fc6c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44380b56d0 0x7f44380d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:59.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.209+0000 7f444a7fc6c0 1 -- 10.20.193.40:0/1467689854 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f44500e3b10 con 0x7f445c112ff0 2026-02-13T01:26:59.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.209+0000 7f444a7fc6c0 1 -- 10.20.193.40:0/1467689854 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f445011c5e0 con 0x7f445c112ff0 2026-02-13T01:26:59.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.210+0000 7f44616496c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44380b56d0 0x7f44380d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:59.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.210+0000 7f44616496c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44380b56d0 0x7f44380d5b80 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f444c004750 tx=0x7f444c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:59.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.334+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f445c10d1b0 con 0x7f445c112ff0 2026-02-13T01:26:59.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.334+0000 7f444a7fc6c0 1 -- 10.20.193.40:0/1467689854 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f44500a65e0 con 0x7f445c112ff0 2026-02-13T01:26:59.336 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:26:59.336 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:59.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44380b56d0 msgr2=0x7f44380d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:59.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44380b56d0 0x7f44380d5b80 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f444c004750 tx=0x7f444c009260 comp rx=0 tx=0).stop 2026-02-13T01:26:59.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 msgr2=0x7f445c173890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:59.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 0x7f445c173890 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4450005dc0 tx=0x7f445000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 shutdown_connections 2026-02-13T01:26:59.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f44380b56d0 0x7f44380d5b80 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f445c0f4d10 0x7f445c0f9fe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f445c112ff0 0x7f445c173890 unknown :-1 s=CLOSED pgs=323 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 --2- 10.20.193.40:0/1467689854 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f445c10cde0 0x7f445c0f46e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:59.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 >> 10.20.193.40:0/1467689854 conn(0x7f445c0ea6a0 msgr2=0x7f445c10b260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:59.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 shutdown_connections 2026-02-13T01:26:59.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:26:59.335+0000 7f446264b6c0 1 -- 10.20.193.40:0/1467689854 wait complete. 2026-02-13T01:26:59.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:26:59 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1467689854' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:59.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:26:59 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1467689854' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:59.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:26:59 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1467689854' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:00.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:00 trial055 ceph-mon[27509]: pgmap v276: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:27:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:00 trial040 ceph-mon[23046]: pgmap v276: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:27:00.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:00 trial118 ceph-mon[27812]: pgmap v276: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:27:02.440 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:02.626 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:02.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:02 trial040 ceph-mon[23046]: pgmap v277: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:27:02.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.824+0000 7f17cdf566c0 1 -- 10.20.193.40:0/3778912518 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17c810fa50 msgr2=0x7f17c8114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:02.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.824+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/3778912518 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17c810fa50 0x7f17c8114a90 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=1231649389303151391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17b00099a0 tx=0x7f17b002ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:02.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.824+0000 7f17cdf566c0 1 -- 10.20.193.40:0/3778912518 shutdown_connections 2026-02-13T01:27:02.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.824+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/3778912518 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17c8115270 0x7f17c8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.824+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/3778912518 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17c810fa50 0x7f17c8114a90 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=1231649389303151391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.824+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/3778912518 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f17c810f060 0x7f17c810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.824+0000 7f17cdf566c0 1 -- 10.20.193.40:0/3778912518 >> 10.20.193.40:0/3778912518 conn(0x7f17c80ec980 msgr2=0x7f17c810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:02.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.824+0000 7f17cdf566c0 1 -- 10.20.193.40:0/3778912518 shutdown_connections 2026-02-13T01:27:02.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.824+0000 7f17cdf566c0 1 -- 10.20.193.40:0/3778912518 wait complete. 2026-02-13T01:27:02.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.825+0000 7f17cdf566c0 1 Processor -- start 2026-02-13T01:27:02.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.825+0000 7f17cdf566c0 1 -- start start 2026-02-13T01:27:02.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.825+0000 7f17cdf566c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17c810f060 0x7f17c80f49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.825+0000 7f17cdf566c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f17c8115270 0x7f17c8175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.825+0000 7f17cdf566c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17c80f5020 0x7f17c80fa2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.825+0000 7f17cdf566c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17c80f5710 con 0x7f17c810f060 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.825+0000 7f17cdf566c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f17c80fa830 con 0x7f17c8115270 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.825+0000 7f17cdf566c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f17c80fa9f0 con 0x7f17c80f5020 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17ccf546c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17c810f060 0x7f17c80f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17bffff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f17c8115270 0x7f17c8175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17bffff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f17c8115270 0x7f17c8175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:59934/0 (socket says 10.20.193.40:59934) 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17bffff6c0 1 -- 10.20.193.40:0/1488865820 learned_addr learned my addr 10.20.193.40:0/1488865820 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17cd7556c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17c80f5020 0x7f17c80fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:02.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17ccf546c0 1 -- 10.20.193.40:0/1488865820 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17c80f5020 msgr2=0x7f17c80fa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17ccf546c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17c80f5020 0x7f17c80fa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17ccf546c0 1 -- 10.20.193.40:0/1488865820 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f17c8115270 msgr2=0x7f17c8175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17ccf546c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f17c8115270 0x7f17c8175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17ccf546c0 1 -- 10.20.193.40:0/1488865820 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b0009590 con 0x7f17c810f060 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17bffff6c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f17c8115270 0x7f17c8175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17ccf546c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17c810f060 0x7f17c80f49f0 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17b800b6e0 tx=0x7f17b800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17bdffb6c0 1 -- 10.20.193.40:0/1488865820 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17b8004a80 con 0x7f17c810f060 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17bdffb6c0 1 -- 10.20.193.40:0/1488865820 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f17b8009030 con 0x7f17c810f060 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17bdffb6c0 1 -- 10.20.193.40:0/1488865820 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17b800ce20 con 0x7f17c810f060 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c80facd0 con 0x7f17c810f060 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.826+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c80fb160 con 0x7f17c810f060 2026-02-13T01:27:02.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.827+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c8110330 con 0x7f17c810f060 2026-02-13T01:27:02.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.829+0000 7f17bdffb6c0 1 -- 10.20.193.40:0/1488865820 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f17b8005000 con 0x7f17c810f060 2026-02-13T01:27:02.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.831+0000 7f17bdffb6c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17a40b57a0 0x7f17a40d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:02.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.831+0000 7f17bdffb6c0 1 -- 10.20.193.40:0/1488865820 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f17b80e37c0 con 0x7f17c810f060 2026-02-13T01:27:02.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.831+0000 7f17bffff6c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17a40b57a0 0x7f17a40d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:02.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.832+0000 7f17bdffb6c0 1 -- 10.20.193.40:0/1488865820 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f17b80a6160 con 0x7f17c810f060 2026-02-13T01:27:02.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.832+0000 7f17bffff6c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17a40b57a0 0x7f17a40d5c50 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17c80fb380 tx=0x7f17b0005ae0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:02.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.955+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f17c80f5b70 con 0x7f17c810f060 2026-02-13T01:27:02.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.955+0000 7f17bdffb6c0 1 -- 10.20.193.40:0/1488865820 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f17b80a9310 con 0x7f17c810f060 2026-02-13T01:27:02.957 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:02.957 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:02.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17a40b57a0 msgr2=0x7f17a40d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:02.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17a40b57a0 0x7f17a40d5c50 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17c80fb380 tx=0x7f17b0005ae0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17c810f060 msgr2=0x7f17c80f49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:02.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17c810f060 0x7f17c80f49f0 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17b800b6e0 tx=0x7f17b800bbb0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 shutdown_connections 2026-02-13T01:27:02.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f17a40b57a0 0x7f17a40d5c50 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f17c80f5020 0x7f17c80fa2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f17c8115270 0x7f17c8175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 --2- 10.20.193.40:0/1488865820 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f17c810f060 0x7f17c80f49f0 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:02.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.956+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 >> 10.20.193.40:0/1488865820 conn(0x7f17c80ec980 msgr2=0x7f17c810d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:02.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.957+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 shutdown_connections 2026-02-13T01:27:02.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:02.957+0000 7f17cdf566c0 1 -- 10.20.193.40:0/1488865820 wait complete. 2026-02-13T01:27:02.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:02 trial055 ceph-mon[27509]: pgmap v277: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:27:03.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:02 trial118 ceph-mon[27812]: pgmap v277: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:27:03.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:03 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1488865820' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:03.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:03 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1488865820' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:04.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:03 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1488865820' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:04.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:04 trial055 ceph-mon[27509]: pgmap v278: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-13T01:27:04.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:04 trial040 ceph-mon[23046]: pgmap v278: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-13T01:27:05.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:04 trial118 ceph-mon[27812]: pgmap v278: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-13T01:27:06.062 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:06.252 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:06.448 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/2051946386 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff788115270 msgr2=0x7ff788175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:06.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/2051946386 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff788115270 0x7ff788175c10 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=7116987543646510927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff77c00aa70 tx=0x7ff77c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/2051946386 shutdown_connections 2026-02-13T01:27:06.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/2051946386 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff788115270 0x7ff788175c10 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=7116987543646510927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/2051946386 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff78810fa50 0x7ff788114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/2051946386 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff78810f060 0x7ff78810f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/2051946386 >> 10.20.193.40:0/2051946386 conn(0x7ff7880ec980 msgr2=0x7ff78810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:06.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/2051946386 shutdown_connections 2026-02-13T01:27:06.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/2051946386 wait complete. 2026-02-13T01:27:06.450 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.447+0000 7ff78c98b6c0 1 Processor -- start 2026-02-13T01:27:06.450 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff78c98b6c0 1 -- start start 2026-02-13T01:27:06.451 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff78c98b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff78810f060 0x7ff78811cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:06.451 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff78c98b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff788115270 0x7ff78811d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:06.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff78c98b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff788122680 0x7ff788122b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:06.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff78c98b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff788123090 con 0x7ff78810f060 2026-02-13T01:27:06.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff78c98b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff788123200 con 0x7ff788122680 2026-02-13T01:27:06.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff78c98b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff7881233c0 con 0x7ff788115270 2026-02-13T01:27:06.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff7877fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff78810f060 0x7ff78811cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:06.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff7877fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff78810f060 0x7ff78811cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:42412/0 (socket says 10.20.193.40:42412) 2026-02-13T01:27:06.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff7877fe6c0 1 -- 10.20.193.40:0/127629795 learned_addr learned my addr 10.20.193.40:0/127629795 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:06.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff786ffd6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff788115270 0x7ff78811d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:06.452 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff787fff6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff788122680 0x7ff788122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:06.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff7877fe6c0 1 -- 10.20.193.40:0/127629795 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff788115270 msgr2=0x7ff78811d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:06.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff7877fe6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff788115270 0x7ff78811d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff7877fe6c0 1 -- 10.20.193.40:0/127629795 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff788122680 msgr2=0x7ff788122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:06.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff7877fe6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff788122680 0x7ff788122b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff7877fe6c0 1 -- 10.20.193.40:0/127629795 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c00a660 con 0x7ff78810f060 2026-02-13T01:27:06.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.448+0000 7ff7877fe6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff78810f060 0x7ff78811cd80 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff774009490 tx=0x7ff77400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:06.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.449+0000 7ff784ff96c0 1 -- 10.20.193.40:0/127629795 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff774004a80 con 0x7ff78810f060 2026-02-13T01:27:06.453 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.449+0000 7ff784ff96c0 1 -- 10.20.193.40:0/127629795 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff774009030 con 0x7ff78810f060 2026-02-13T01:27:06.454 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.449+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff788163870 con 0x7ff78810f060 2026-02-13T01:27:06.454 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.449+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff788163d00 con 0x7ff78810f060 2026-02-13T01:27:06.454 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.449+0000 7ff784ff96c0 1 -- 10.20.193.40:0/127629795 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7740071c0 con 0x7ff78810f060 2026-02-13T01:27:06.454 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.449+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff788110330 con 0x7ff78810f060 2026-02-13T01:27:06.455 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.451+0000 7ff784ff96c0 1 -- 10.20.193.40:0/127629795 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff774004e90 con 0x7ff78810f060 2026-02-13T01:27:06.455 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.453+0000 7ff784ff96c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff75c0b5720 0x7ff75c0d5bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:06.455 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.453+0000 7ff784ff96c0 1 -- 10.20.193.40:0/127629795 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7ff7740e3c80 con 0x7ff78810f060 2026-02-13T01:27:06.455 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.453+0000 7ff786ffd6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff75c0b5720 0x7ff75c0d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:06.455 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.453+0000 7ff784ff96c0 1 -- 10.20.193.40:0/127629795 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff7740e4100 con 0x7ff78810f060 2026-02-13T01:27:06.455 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.454+0000 7ff786ffd6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff75c0b5720 0x7ff75c0d5bd0 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff788123710 tx=0x7ff778009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:06.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.578+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff78810f430 con 0x7ff78810f060 2026-02-13T01:27:06.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.578+0000 7ff784ff96c0 1 -- 10.20.193.40:0/127629795 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff7740a6620 con 0x7ff78810f060 2026-02-13T01:27:06.580 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:06.580 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:06.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff75c0b5720 msgr2=0x7ff75c0d5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:06.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff75c0b5720 0x7ff75c0d5bd0 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff788123710 tx=0x7ff778009260 comp rx=0 tx=0).stop 2026-02-13T01:27:06.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff78810f060 msgr2=0x7ff78811cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:06.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff78810f060 0x7ff78811cd80 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff774009490 tx=0x7ff77400bc50 comp rx=0 tx=0).stop 2026-02-13T01:27:06.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 shutdown_connections 2026-02-13T01:27:06.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff75c0b5720 0x7ff75c0d5bd0 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff788122680 0x7ff788122b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff788115270 0x7ff78811d2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 --2- 10.20.193.40:0/127629795 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff78810f060 0x7ff78811cd80 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 >> 10.20.193.40:0/127629795 conn(0x7ff7880ec980 msgr2=0x7ff78810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:06.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 shutdown_connections 2026-02-13T01:27:06.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:06.579+0000 7ff78c98b6c0 1 -- 10.20.193.40:0/127629795 wait complete. 2026-02-13T01:27:06.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:06 trial055 ceph-mon[27509]: pgmap v279: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:27:06.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:06 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/127629795' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:06.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:06 trial040 ceph-mon[23046]: pgmap v279: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:27:06.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:06 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/127629795' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:07.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:06 trial118 ceph-mon[27812]: pgmap v279: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:27:07.004 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:06 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/127629795' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:08.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:08 trial055 ceph-mon[27509]: pgmap v280: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:27:08.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:08 trial040 ceph-mon[23046]: pgmap v280: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:27:09.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:08 trial118 ceph-mon[27812]: pgmap v280: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:27:09.684 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:09.870 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:10.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.059+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/2726184558 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b3410fbf0 msgr2=0x7f7b34114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.059+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/2726184558 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b3410fbf0 0x7f7b34114c30 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=15490438777759586741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b240099a0 tx=0x7f7b2402ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:10.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.059+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/2726184558 shutdown_connections 2026-02-13T01:27:10.061 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.059+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/2726184558 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b34115410 0x7f7b34175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.061 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.059+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/2726184558 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b3410fbf0 0x7f7b34114c30 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=15490438777759586741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.061 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.059+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/2726184558 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b3410f200 0x7f7b3410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.061 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.059+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/2726184558 >> 10.20.193.40:0/2726184558 conn(0x7f7b340ecb00 msgr2=0x7f7b3410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:10.061 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.059+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/2726184558 shutdown_connections 2026-02-13T01:27:10.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.060+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/2726184558 wait complete. 2026-02-13T01:27:10.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.060+0000 7f7b39ce56c0 1 Processor -- start 2026-02-13T01:27:10.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.060+0000 7f7b39ce56c0 1 -- start start 2026-02-13T01:27:10.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.060+0000 7f7b39ce56c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b3410f200 0x7f7b340f49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:10.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.060+0000 7f7b39ce56c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b34115410 0x7f7b34175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:10.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b39ce56c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b340f5000 0x7f7b340fa2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:10.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b39ce56c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340f56f0 con 0x7f7b340f5000 2026-02-13T01:27:10.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b39ce56c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340fa810 con 0x7f7b34115410 2026-02-13T01:27:10.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b39ce56c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340fa9d0 con 0x7f7b3410f200 2026-02-13T01:27:10.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b32ffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b34115410 0x7f7b34175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:10.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b32ffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b34115410 0x7f7b34175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:46980/0 (socket says 10.20.193.40:46980) 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b32ffd6c0 1 -- 10.20.193.40:0/1716920929 learned_addr learned my addr 10.20.193.40:0/1716920929 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b337fe6c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b3410f200 0x7f7b340f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b33fff6c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b340f5000 0x7f7b340fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b32ffd6c0 1 -- 10.20.193.40:0/1716920929 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b3410f200 msgr2=0x7f7b340f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b32ffd6c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b3410f200 0x7f7b340f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b32ffd6c0 1 -- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b340f5000 msgr2=0x7f7b340fa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b32ffd6c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b340f5000 0x7f7b340fa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b32ffd6c0 1 -- 10.20.193.40:0/1716920929 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b24009590 con 0x7f7b34115410 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b33fff6c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b340f5000 0x7f7b340fa2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b32ffd6c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b34115410 0x7f7b34175cb0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b240092e0 tx=0x7f7b2402f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:10.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.061+0000 7f7b30ff96c0 1 -- 10.20.193.40:0/1716920929 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b240046b0 con 0x7f7b34115410 2026-02-13T01:27:10.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.062+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b340fac50 con 0x7f7b34115410 2026-02-13T01:27:10.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.062+0000 7f7b30ff96c0 1 -- 10.20.193.40:0/1716920929 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7b24031560 con 0x7f7b34115410 2026-02-13T01:27:10.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.062+0000 7f7b30ff96c0 1 -- 10.20.193.40:0/1716920929 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b24007e10 con 0x7f7b34115410 2026-02-13T01:27:10.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.062+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b340fb120 con 0x7f7b34115410 2026-02-13T01:27:10.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.062+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b341104d0 con 0x7f7b34115410 2026-02-13T01:27:10.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.064+0000 7f7b30ff96c0 1 -- 10.20.193.40:0/1716920929 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f7b240316d0 con 0x7f7b34115410 2026-02-13T01:27:10.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.066+0000 7f7b30ff96c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b080b5650 0x7f7b080d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:10.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.066+0000 7f7b30ff96c0 1 -- 10.20.193.40:0/1716920929 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f7b24107ca0 con 0x7f7b34115410 2026-02-13T01:27:10.067 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.066+0000 7f7b337fe6c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b080b5650 0x7f7b080d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:10.068 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.066+0000 7f7b30ff96c0 1 -- 10.20.193.40:0/1716920929 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7b24108120 con 0x7f7b34115410 2026-02-13T01:27:10.068 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.067+0000 7f7b337fe6c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b080b5650 0x7f7b080d5b00 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b20004750 tx=0x7f7b20009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:10.194 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.193+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b3410f5d0 con 0x7f7b34115410 2026-02-13T01:27:10.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.193+0000 7f7b30ff96c0 1 -- 10.20.193.40:0/1716920929 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7b240ca640 con 0x7f7b34115410 2026-02-13T01:27:10.195 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:10.195 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:10.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b080b5650 msgr2=0x7f7b080d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b080b5650 0x7f7b080d5b00 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b20004750 tx=0x7f7b20009390 comp rx=0 tx=0).stop 2026-02-13T01:27:10.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b34115410 msgr2=0x7f7b34175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b34115410 0x7f7b34175cb0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b240092e0 tx=0x7f7b2402f810 comp rx=0 tx=0).stop 2026-02-13T01:27:10.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 shutdown_connections 2026-02-13T01:27:10.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7b080b5650 0x7f7b080d5b00 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7b340f5000 0x7f7b340fa2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7b34115410 0x7f7b34175cb0 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 --2- 10.20.193.40:0/1716920929 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7b3410f200 0x7f7b340f49d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 >> 10.20.193.40:0/1716920929 conn(0x7f7b340ecb00 msgr2=0x7f7b3410d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:10.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 shutdown_connections 2026-02-13T01:27:10.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:10.195+0000 7f7b39ce56c0 1 -- 10.20.193.40:0/1716920929 wait complete. 2026-02-13T01:27:10.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:10 trial055 ceph-mon[27509]: pgmap v281: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:10.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:10 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1716920929' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:10.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:10 trial040 ceph-mon[23046]: pgmap v281: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:10.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:10 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1716920929' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:11.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:10 trial118 ceph-mon[27812]: pgmap v281: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:11.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:10 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1716920929' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:12.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:12 trial055 ceph-mon[27509]: pgmap v282: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:12.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:12 trial040 ceph-mon[23046]: pgmap v282: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:13.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:12 trial118 ceph-mon[27812]: pgmap v282: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:13.333 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:13.516 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:13.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.714+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/820561367 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff4b010f060 msgr2=0x7ff4b010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.715 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.714+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/820561367 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff4b010f060 0x7ff4b010f430 secure :-1 s=READY pgs=329 gs=2 cs=0 l=1 c_cookie=4945327927314787190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a00099a0 tx=0x7ff4a002ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:13.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.716+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/820561367 shutdown_connections 2026-02-13T01:27:13.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.716+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/820561367 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff4b0115270 0x7ff4b0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.716+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/820561367 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff4b010fa50 0x7ff4b0114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.716+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/820561367 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff4b010f060 0x7ff4b010f430 unknown :-1 s=CLOSED pgs=329 gs=2 cs=0 l=1 c_cookie=4945327927314787190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.716+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/820561367 >> 10.20.193.40:0/820561367 conn(0x7ff4b00ec980 msgr2=0x7ff4b010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:13.717 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.716+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/820561367 shutdown_connections 2026-02-13T01:27:13.717 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.716+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/820561367 wait complete. 2026-02-13T01:27:13.717 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.716+0000 7ff4b5d0b6c0 1 Processor -- start 2026-02-13T01:27:13.717 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.716+0000 7ff4b5d0b6c0 1 -- start start 2026-02-13T01:27:13.717 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b5d0b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff4b010f060 0x7ff4b011ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:13.717 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b5d0b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff4b0115270 0x7ff4b011d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b5d0b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff4b0122790 0x7ff4b0122c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b5d0b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b01231a0 con 0x7ff4b0122790 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b5d0b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b0123310 con 0x7ff4b010f060 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b5d0b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b01234d0 con 0x7ff4b0115270 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4a7fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff4b0115270 0x7ff4b011d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b550a6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff4b0122790 0x7ff4b0122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4a7fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff4b0115270 0x7ff4b011d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:43576/0 (socket says 10.20.193.40:43576) 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4a7fff6c0 1 -- 10.20.193.40:0/3396505796 learned_addr learned my addr 10.20.193.40:0/3396505796 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b4d096c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff4b010f060 0x7ff4b011ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b550a6c0 1 -- 10.20.193.40:0/3396505796 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff4b0115270 msgr2=0x7ff4b011d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b550a6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff4b0115270 0x7ff4b011d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b550a6c0 1 -- 10.20.193.40:0/3396505796 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff4b010f060 msgr2=0x7ff4b011ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b550a6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff4b010f060 0x7ff4b011ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b550a6c0 1 -- 10.20.193.40:0/3396505796 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a0009590 con 0x7ff4b0122790 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.717+0000 7ff4b550a6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff4b0122790 0x7ff4b0122c30 secure :-1 s=READY pgs=330 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ac00c6c0 tx=0x7ff4ac00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:13.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.718+0000 7ff4a5ffb6c0 1 -- 10.20.193.40:0/3396505796 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4ac005340 con 0x7ff4b0122790 2026-02-13T01:27:13.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.718+0000 7ff4a5ffb6c0 1 -- 10.20.193.40:0/3396505796 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff4ac003d40 con 0x7ff4b0122790 2026-02-13T01:27:13.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.718+0000 7ff4a5ffb6c0 1 -- 10.20.193.40:0/3396505796 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4ac00de30 con 0x7ff4b0122790 2026-02-13T01:27:13.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.718+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b0163980 con 0x7ff4b0122790 2026-02-13T01:27:13.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.718+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b0163e10 con 0x7ff4b0122790 2026-02-13T01:27:13.720 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.718+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b0110330 con 0x7ff4b0122790 2026-02-13T01:27:13.721 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.720+0000 7ff4a5ffb6c0 1 -- 10.20.193.40:0/3396505796 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff4ac00d410 con 0x7ff4b0122790 2026-02-13T01:27:13.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.722+0000 7ff4a5ffb6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff48c0b56d0 0x7ff48c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:13.722 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.722+0000 7ff4a5ffb6c0 1 -- 10.20.193.40:0/3396505796 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7ff4ac0e4a20 con 0x7ff4b0122790 2026-02-13T01:27:13.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.722+0000 7ff4b4d096c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff48c0b56d0 0x7ff48c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:13.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.722+0000 7ff4a5ffb6c0 1 -- 10.20.193.40:0/3396505796 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff4ac11d5e0 con 0x7ff4b0122790 2026-02-13T01:27:13.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.723+0000 7ff4b4d096c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff48c0b56d0 0x7ff48c0d5b80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a0005b40 tx=0x7ff4a00023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:13.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.847+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff4b011dfe0 con 0x7ff4b0122790 2026-02-13T01:27:13.848 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:13.848 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:13.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.847+0000 7ff4a5ffb6c0 1 -- 10.20.193.40:0/3396505796 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff4ac0a73c0 con 0x7ff4b0122790 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff48c0b56d0 msgr2=0x7ff48c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff48c0b56d0 0x7ff48c0d5b80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a0005b40 tx=0x7ff4a00023a0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff4b0122790 msgr2=0x7ff4b0122c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff4b0122790 0x7ff4b0122c30 secure :-1 s=READY pgs=330 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ac00c6c0 tx=0x7ff4ac00cb90 comp rx=0 tx=0).stop 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 shutdown_connections 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ff48c0b56d0 0x7ff48c0d5b80 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff4b0122790 0x7ff4b0122c30 unknown :-1 s=CLOSED pgs=330 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ff4b0115270 0x7ff4b011d3d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 --2- 10.20.193.40:0/3396505796 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ff4b010f060 0x7ff4b011ce90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 >> 10.20.193.40:0/3396505796 conn(0x7ff4b00ec980 msgr2=0x7ff4b010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 shutdown_connections 2026-02-13T01:27:13.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:13.848+0000 7ff4b5d0b6c0 1 -- 10.20.193.40:0/3396505796 wait complete. 2026-02-13T01:27:14.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:14 trial055 ceph-mon[27509]: pgmap v283: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:14.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:14 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3396505796' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:14.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:14 trial040 ceph-mon[23046]: pgmap v283: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:14.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:14 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3396505796' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:15.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:14 trial118 ceph-mon[27812]: pgmap v283: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:15.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:14 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3396505796' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:16.955 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:16.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:16 trial055 ceph-mon[27509]: pgmap v284: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:16.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:16 trial040 ceph-mon[23046]: pgmap v284: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:17.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:16 trial118 ceph-mon[27812]: pgmap v284: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:17.140 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.324+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/43709340 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d4010f200 msgr2=0x7f8d4010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.324+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/43709340 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d4010f200 0x7f8d4010f5d0 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=7373135126994708165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2c0099a0 tx=0x7f8d2c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.325+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/43709340 shutdown_connections 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.325+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/43709340 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8d40115410 0x7f8d40175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.325+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/43709340 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8d4010fbf0 0x7f8d40114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.325+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/43709340 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d4010f200 0x7f8d4010f5d0 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=7373135126994708165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.325+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/43709340 >> 10.20.193.40:0/43709340 conn(0x7f8d400ecb00 msgr2=0x7f8d4010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.325+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/43709340 shutdown_connections 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.325+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/43709340 wait complete. 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.325+0000 7f8d46a5c6c0 1 Processor -- start 2026-02-13T01:27:17.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d46a5c6c0 1 -- start start 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d46a5c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8d4010f200 0x7f8d4011d090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d46a5c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8d40115410 0x7f8d4011d5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d46a5c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d40122990 0x7f8d40122e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d46a5c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401233a0 con 0x7f8d40122990 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d46a5c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40123510 con 0x7f8d40115410 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d46a5c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401236d0 con 0x7f8d4010f200 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d3ffff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8d4010f200 0x7f8d4011d090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d3ffff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8d4010f200 0x7f8d4011d090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:43598/0 (socket says 10.20.193.40:43598) 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d3ffff6c0 1 -- 10.20.193.40:0/3006477801 learned_addr learned my addr 10.20.193.40:0/3006477801 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d44fd26c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d40122990 0x7f8d40122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d3f7fe6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8d40115410 0x7f8d4011d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d44fd26c0 1 -- 10.20.193.40:0/3006477801 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8d4010f200 msgr2=0x7f8d4011d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d44fd26c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8d4010f200 0x7f8d4011d090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d44fd26c0 1 -- 10.20.193.40:0/3006477801 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8d40115410 msgr2=0x7f8d4011d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d44fd26c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8d40115410 0x7f8d4011d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d44fd26c0 1 -- 10.20.193.40:0/3006477801 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c009590 con 0x7f8d40122990 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.326+0000 7f8d44fd26c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d40122990 0x7f8d40122e30 secure :-1 s=READY pgs=332 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d3400c6c0 tx=0x7f8d3400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.327+0000 7f8d3d7fa6c0 1 -- 10.20.193.40:0/3006477801 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d34005340 con 0x7f8d40122990 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.327+0000 7f8d3d7fa6c0 1 -- 10.20.193.40:0/3006477801 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8d34003d40 con 0x7f8d40122990 2026-02-13T01:27:17.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.327+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d40163b80 con 0x7f8d40122990 2026-02-13T01:27:17.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.327+0000 7f8d3d7fa6c0 1 -- 10.20.193.40:0/3006477801 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d3400de30 con 0x7f8d40122990 2026-02-13T01:27:17.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.327+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d40164060 con 0x7f8d40122990 2026-02-13T01:27:17.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.329+0000 7f8d3d7fa6c0 1 -- 10.20.193.40:0/3006477801 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8d3400d410 con 0x7f8d40122990 2026-02-13T01:27:17.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.330+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d401104d0 con 0x7f8d40122990 2026-02-13T01:27:17.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.331+0000 7f8d3d7fa6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8d140b56d0 0x7f8d140d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:17.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.331+0000 7f8d3d7fa6c0 1 -- 10.20.193.40:0/3006477801 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f8d340e4a20 con 0x7f8d40122990 2026-02-13T01:27:17.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.331+0000 7f8d3ffff6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8d140b56d0 0x7f8d140d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:17.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.332+0000 7f8d3ffff6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8d140b56d0 0x7f8d140d5b80 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2c0023e0 tx=0x7f8d2c005b00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:17.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.332+0000 7f8d3d7fa6c0 1 -- 10.20.193.40:0/3006477801 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8d340a73c0 con 0x7f8d40122990 2026-02-13T01:27:17.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.456+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8d4011e210 con 0x7f8d40122990 2026-02-13T01:27:17.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.456+0000 7f8d3d7fa6c0 1 -- 10.20.193.40:0/3006477801 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8d340aa570 con 0x7f8d40122990 2026-02-13T01:27:17.457 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:17.457 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:17.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8d140b56d0 msgr2=0x7f8d140d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8d140b56d0 0x7f8d140d5b80 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2c0023e0 tx=0x7f8d2c005b00 comp rx=0 tx=0).stop 2026-02-13T01:27:17.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d40122990 msgr2=0x7f8d40122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d40122990 0x7f8d40122e30 secure :-1 s=READY pgs=332 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d3400c6c0 tx=0x7f8d3400cb90 comp rx=0 tx=0).stop 2026-02-13T01:27:17.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 shutdown_connections 2026-02-13T01:27:17.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8d140b56d0 0x7f8d140d5b80 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d40122990 0x7f8d40122e30 unknown :-1 s=CLOSED pgs=332 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8d40115410 0x7f8d4011d5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 --2- 10.20.193.40:0/3006477801 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8d4010f200 0x7f8d4011d090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.457+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 >> 10.20.193.40:0/3006477801 conn(0x7f8d400ecb00 msgr2=0x7f8d4010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:17.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.458+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 shutdown_connections 2026-02-13T01:27:17.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:17.458+0000 7f8d46a5c6c0 1 -- 10.20.193.40:0/3006477801 wait complete. 2026-02-13T01:27:17.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:17 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3006477801' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:17.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:17 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3006477801' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:18.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:17 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3006477801' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:18.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:18 trial055 ceph-mon[27509]: pgmap v285: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:18.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:18 trial040 ceph-mon[23046]: pgmap v285: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:19.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:18 trial118 ceph-mon[27812]: pgmap v285: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:20.562 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:20.747 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:20.878 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:20 trial040 ceph-mon[23046]: pgmap v286: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:20.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.937+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/1563039485 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc115270 msgr2=0x7f8ffc175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:20.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.937+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/1563039485 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc115270 0x7f8ffc175c10 secure :-1 s=READY pgs=333 gs=2 cs=0 l=1 c_cookie=38727589376696947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ff800aa70 tx=0x7f8ff802fde0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.937+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/1563039485 shutdown_connections 2026-02-13T01:27:20.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.937+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/1563039485 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc115270 0x7f8ffc175c10 unknown :-1 s=CLOSED pgs=333 gs=2 cs=0 l=1 c_cookie=38727589376696947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.937+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/1563039485 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8ffc10fa50 0x7f8ffc114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.937+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/1563039485 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8ffc10f060 0x7f8ffc10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.937+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/1563039485 >> 10.20.193.40:0/1563039485 conn(0x7f8ffc0ec980 msgr2=0x7f8ffc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:20.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.937+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/1563039485 shutdown_connections 2026-02-13T01:27:20.939 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.937+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/1563039485 wait complete. 2026-02-13T01:27:20.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.938+0000 7f9002cdb6c0 1 Processor -- start 2026-02-13T01:27:20.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.938+0000 7f9002cdb6c0 1 -- start start 2026-02-13T01:27:20.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.938+0000 7f9002cdb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc10f060 0x7f8ffc11cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.938+0000 7f9002cdb6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8ffc115270 0x7f8ffc11d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.938+0000 7f9002cdb6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8ffc122690 0x7f8ffc122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.938+0000 7f9002cdb6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc1230a0 con 0x7f8ffc10f060 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.938+0000 7f9002cdb6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc123210 con 0x7f8ffc115270 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.938+0000 7f9002cdb6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc1233d0 con 0x7f8ffc122690 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9001cd96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc10f060 0x7f8ffc11cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9001cd96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc10f060 0x7f8ffc11cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:36946/0 (socket says 10.20.193.40:36946) 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9001cd96c0 1 -- 10.20.193.40:0/3565293266 learned_addr learned my addr 10.20.193.40:0/3565293266 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f90014d86c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8ffc115270 0x7f8ffc11d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f90024da6c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8ffc122690 0x7f8ffc122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9001cd96c0 1 -- 10.20.193.40:0/3565293266 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8ffc122690 msgr2=0x7f8ffc122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:20.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9001cd96c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8ffc122690 0x7f8ffc122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9001cd96c0 1 -- 10.20.193.40:0/3565293266 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8ffc115270 msgr2=0x7f8ffc11d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9001cd96c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8ffc115270 0x7f8ffc11d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9001cd96c0 1 -- 10.20.193.40:0/3565293266 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff800a660 con 0x7f8ffc10f060 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f90024da6c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8ffc122690 0x7f8ffc122b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9001cd96c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc10f060 0x7f8ffc11cd90 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fec009490 tx=0x7f8fec00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f8feaffd6c0 1 -- 10.20.193.40:0/3565293266 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fec004a80 con 0x7f8ffc10f060 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f8feaffd6c0 1 -- 10.20.193.40:0/3565293266 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8fec009030 con 0x7f8ffc10f060 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f8feaffd6c0 1 -- 10.20.193.40:0/3565293266 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fec0071c0 con 0x7f8ffc10f060 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc163880 con 0x7f8ffc10f060 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.939+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc163d10 con 0x7f8ffc10f060 2026-02-13T01:27:20.943 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.940+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc4005310 con 0x7f8ffc10f060 2026-02-13T01:27:20.944 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.942+0000 7f8feaffd6c0 1 -- 10.20.193.40:0/3565293266 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8fec004060 con 0x7f8ffc10f060 2026-02-13T01:27:20.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.944+0000 7f8feaffd6c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8fd80b56d0 0x7f8fd80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:20.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.944+0000 7f8feaffd6c0 1 -- 10.20.193.40:0/3565293266 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f8fec0e3bf0 con 0x7f8ffc10f060 2026-02-13T01:27:20.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.944+0000 7f8feaffd6c0 1 -- 10.20.193.40:0/3565293266 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8fec11c660 con 0x7f8ffc10f060 2026-02-13T01:27:20.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.944+0000 7f90014d86c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8fd80b56d0 0x7f8fd80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:20.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:20.944+0000 7f90014d86c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8fd80b56d0 0x7f8fd80d5b80 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ffc123720 tx=0x7f8ff00093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:20.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:20 trial055 ceph-mon[27509]: pgmap v286: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:21.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:20 trial118 ceph-mon[27812]: pgmap v286: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:21.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.076+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8fc4005960 con 0x7f8ffc10f060 2026-02-13T01:27:21.077 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.076+0000 7f8feaffd6c0 1 -- 10.20.193.40:0/3565293266 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8fec0a6590 con 0x7f8ffc10f060 2026-02-13T01:27:21.078 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:21.078 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:21.079 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8fd80b56d0 msgr2=0x7f8fd80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:21.079 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8fd80b56d0 0x7f8fd80d5b80 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ffc123720 tx=0x7f8ff00093f0 comp rx=0 tx=0).stop 2026-02-13T01:27:21.079 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc10f060 msgr2=0x7f8ffc11cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:21.079 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc10f060 0x7f8ffc11cd90 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fec009490 tx=0x7f8fec00bc50 comp rx=0 tx=0).stop 2026-02-13T01:27:21.079 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 shutdown_connections 2026-02-13T01:27:21.079 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f8fd80b56d0 0x7f8fd80d5b80 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:21.079 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8ffc122690 0x7f8ffc122b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:21.080 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f8ffc115270 0x7f8ffc11d2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:21.080 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 --2- 10.20.193.40:0/3565293266 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8ffc10f060 0x7f8ffc11cd90 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:21.080 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 >> 10.20.193.40:0/3565293266 conn(0x7f8ffc0ec980 msgr2=0x7f8ffc10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:21.080 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 shutdown_connections 2026-02-13T01:27:21.080 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:21.077+0000 7f9002cdb6c0 1 -- 10.20.193.40:0/3565293266 wait complete. 2026-02-13T01:27:21.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:21 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3565293266' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:21.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:21 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3565293266' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:22.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:21 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3565293266' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:22.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:22 trial055 ceph-mon[27509]: pgmap v287: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:22.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:22 trial040 ceph-mon[23046]: pgmap v287: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:23.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:22 trial118 ceph-mon[27812]: pgmap v287: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:24.182 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:24.369 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:24.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.562+0000 7f3888d736c0 1 -- 10.20.193.40:0/2668108778 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f38841199a0 msgr2=0x7f3884116df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:24.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.562+0000 7f3888d736c0 1 --2- 10.20.193.40:0/2668108778 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f38841199a0 0x7f3884116df0 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=10964523622485147565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f387800aa40 tx=0x7f387802fdf0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.562+0000 7f3888d736c0 1 -- 10.20.193.40:0/2668108778 shutdown_connections 2026-02-13T01:27:24.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.562+0000 7f3888d736c0 1 --2- 10.20.193.40:0/2668108778 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f38841199a0 0x7f3884116df0 unknown :-1 s=CLOSED pgs=335 gs=1 cs=0 l=1 c_cookie=10964523622485147565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.562+0000 7f3888d736c0 1 --2- 10.20.193.40:0/2668108778 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f3884118f30 0x7f3884119380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.562+0000 7f3888d736c0 1 --2- 10.20.193.40:0/2668108778 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f388411b3f0 0x7f388411b7c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.562+0000 7f3888d736c0 1 -- 10.20.193.40:0/2668108778 >> 10.20.193.40:0/2668108778 conn(0x7f388405b290 msgr2=0x7f388405b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:24.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.562+0000 7f3888d736c0 1 -- 10.20.193.40:0/2668108778 shutdown_connections 2026-02-13T01:27:24.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.562+0000 7f3888d736c0 1 -- 10.20.193.40:0/2668108778 wait complete. 2026-02-13T01:27:24.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3888d736c0 1 Processor -- start 2026-02-13T01:27:24.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3888d736c0 1 -- start start 2026-02-13T01:27:24.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3888d736c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3884118f30 0x7f38840fd990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:24.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3888d736c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38841199a0 0x7f38840fded0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:24.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3888d736c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f388411b3f0 0x7f3884103290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:24.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3888d736c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3884103850 con 0x7f3884118f30 2026-02-13T01:27:24.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3888d736c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f38841039c0 con 0x7f38841199a0 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3888d736c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3884103b80 con 0x7f388411b3f0 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f38837fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3884118f30 0x7f38840fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f38837fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3884118f30 0x7f38840fd990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:36968/0 (socket says 10.20.193.40:36968) 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f38837fe6c0 1 -- 10.20.193.40:0/369188933 learned_addr learned my addr 10.20.193.40:0/369188933 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3882ffd6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38841199a0 0x7f38840fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.563+0000 7f3883fff6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f388411b3f0 0x7f3884103290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f38837fe6c0 1 -- 10.20.193.40:0/369188933 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f388411b3f0 msgr2=0x7f3884103290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f38837fe6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f388411b3f0 0x7f3884103290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f38837fe6c0 1 -- 10.20.193.40:0/369188933 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38841199a0 msgr2=0x7f38840fded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f38837fe6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38841199a0 0x7f38840fded0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f38837fe6c0 1 -- 10.20.193.40:0/369188933 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387800a660 con 0x7f3884118f30 2026-02-13T01:27:24.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f38837fe6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3884118f30 0x7f38840fd990 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f387000b6c0 tx=0x7f387000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:24.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f3880ff96c0 1 -- 10.20.193.40:0/369188933 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38700044a0 con 0x7f3884118f30 2026-02-13T01:27:24.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f3880ff96c0 1 -- 10.20.193.40:0/369188933 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3870009030 con 0x7f3884118f30 2026-02-13T01:27:24.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f3880ff96c0 1 -- 10.20.193.40:0/369188933 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38700071c0 con 0x7f3884118f30 2026-02-13T01:27:24.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f3888d736c0 1 -- 10.20.193.40:0/369188933 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3884103e60 con 0x7f3884118f30 2026-02-13T01:27:24.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.564+0000 7f3888d736c0 1 -- 10.20.193.40:0/369188933 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38841045b0 con 0x7f3884118f30 2026-02-13T01:27:24.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.565+0000 7f385e7fc6c0 1 -- 10.20.193.40:0/369188933 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388405e670 con 0x7f3884118f30 2026-02-13T01:27:24.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.567+0000 7f3880ff96c0 1 -- 10.20.193.40:0/369188933 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f387000c410 con 0x7f3884118f30 2026-02-13T01:27:24.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.568+0000 7f3880ff96c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38580b56d0 0x7f38580d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:24.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.568+0000 7f3880ff96c0 1 -- 10.20.193.40:0/369188933 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f38700e3a50 con 0x7f3884118f30 2026-02-13T01:27:24.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.568+0000 7f3882ffd6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38580b56d0 0x7f38580d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:24.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.569+0000 7f3882ffd6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38580b56d0 0x7f38580d5b80 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3884104320 tx=0x7f3874005e60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:24.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.569+0000 7f3880ff96c0 1 -- 10.20.193.40:0/369188933 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f38700a63f0 con 0x7f3884118f30 2026-02-13T01:27:24.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.694+0000 7f385e7fc6c0 1 -- 10.20.193.40:0/369188933 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f38840feae0 con 0x7f3884118f30 2026-02-13T01:27:24.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.694+0000 7f3880ff96c0 1 -- 10.20.193.40:0/369188933 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f38700a95a0 con 0x7f3884118f30 2026-02-13T01:27:24.695 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:24.695 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:24.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 -- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38580b56d0 msgr2=0x7f38580d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38580b56d0 0x7f38580d5b80 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3884104320 tx=0x7f3874005e60 comp rx=0 tx=0).stop 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 -- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3884118f30 msgr2=0x7f38840fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3884118f30 0x7f38840fd990 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f387000b6c0 tx=0x7f387000bb90 comp rx=0 tx=0).stop 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 -- 10.20.193.40:0/369188933 shutdown_connections 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f38580b56d0 0x7f38580d5b80 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f388411b3f0 0x7f3884103290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f38841199a0 0x7f38840fded0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 --2- 10.20.193.40:0/369188933 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3884118f30 0x7f38840fd990 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 -- 10.20.193.40:0/369188933 >> 10.20.193.40:0/369188933 conn(0x7f388405b290 msgr2=0x7f38840f8210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:24.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 -- 10.20.193.40:0/369188933 shutdown_connections 2026-02-13T01:27:24.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:24.695+0000 7f385e7fc6c0 1 -- 10.20.193.40:0/369188933 wait complete. 2026-02-13T01:27:24.758 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:24 trial040 ceph-mon[23046]: pgmap v288: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:24.759 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:24 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/369188933' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:24.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:24 trial055 ceph-mon[27509]: pgmap v288: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:24.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:24 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/369188933' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:25.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:24 trial118 ceph-mon[27812]: pgmap v288: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:25.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:24 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/369188933' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:26.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:26 trial055 ceph-mon[27509]: pgmap v289: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:26.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:26 trial040 ceph-mon[23046]: pgmap v289: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:27.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:26 trial118 ceph-mon[27812]: pgmap v289: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:27.837 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:28.020 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.217+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2716404695 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4116520 msgr2=0x7fc7e417a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.217+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2716404695 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4116520 0x7fc7e417a100 secure :-1 s=READY pgs=337 gs=2 cs=0 l=1 c_cookie=13436279646573450518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7e000aa70 tx=0x7fc7e002fde0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.217+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2716404695 shutdown_connections 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.217+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2716404695 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4116520 0x7fc7e417a100 unknown :-1 s=CLOSED pgs=337 gs=2 cs=0 l=1 c_cookie=13436279646573450518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.217+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2716404695 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc7e4114190 0x7fc7e4115d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.217+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2716404695 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc7e41137a0 0x7fc7e4113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.217+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2716404695 >> 10.20.193.40:0/2716404695 conn(0x7fc7e4061510 msgr2=0x7fc7e4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.217+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2716404695 shutdown_connections 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.217+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2716404695 wait complete. 2026-02-13T01:27:28.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7ea4cf6c0 1 Processor -- start 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7ea4cf6c0 1 -- start start 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7ea4cf6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc7e41137a0 0x7fc7e41212e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7ea4cf6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc7e4116520 0x7fc7e4121820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7ea4cf6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4126b90 0x7fc7e4127030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7ea4cf6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41275a0 con 0x7fc7e4126b90 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7ea4cf6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4127710 con 0x7fc7e4116520 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7ea4cf6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41278d0 con 0x7fc7e41137a0 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7e9cce6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4126b90 0x7fc7e4127030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7e8ccc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc7e4116520 0x7fc7e4121820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7e9cce6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4126b90 0x7fc7e4127030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:36990/0 (socket says 10.20.193.40:36990) 2026-02-13T01:27:28.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7e9cce6c0 1 -- 10.20.193.40:0/2270078255 learned_addr learned my addr 10.20.193.40:0/2270078255 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:28.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.218+0000 7fc7e94cd6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc7e41137a0 0x7fc7e41212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:28.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7e9cce6c0 1 -- 10.20.193.40:0/2270078255 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc7e41137a0 msgr2=0x7fc7e41212e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:28.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7e9cce6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc7e41137a0 0x7fc7e41212e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7e9cce6c0 1 -- 10.20.193.40:0/2270078255 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc7e4116520 msgr2=0x7fc7e4121820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:28.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7e9cce6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc7e4116520 0x7fc7e4121820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7e9cce6c0 1 -- 10.20.193.40:0/2270078255 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e000a660 con 0x7fc7e4126b90 2026-02-13T01:27:28.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7e9cce6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4126b90 0x7fc7e4127030 secure :-1 s=READY pgs=338 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7e000ab70 tx=0x7fc7e0032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:28.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7d27fc6c0 1 -- 10.20.193.40:0/2270078255 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7e00054a0 con 0x7fc7e4126b90 2026-02-13T01:27:28.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7d27fc6c0 1 -- 10.20.193.40:0/2270078255 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc7e0003d40 con 0x7fc7e4126b90 2026-02-13T01:27:28.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7d27fc6c0 1 -- 10.20.193.40:0/2270078255 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7e0032030 con 0x7fc7e4126b90 2026-02-13T01:27:28.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e4167d20 con 0x7fc7e4126b90 2026-02-13T01:27:28.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.219+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e4168150 con 0x7fc7e4126b90 2026-02-13T01:27:28.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.220+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e4114840 con 0x7fc7e4126b90 2026-02-13T01:27:28.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.222+0000 7fc7d27fc6c0 1 -- 10.20.193.40:0/2270078255 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fc7e0005600 con 0x7fc7e4126b90 2026-02-13T01:27:28.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.224+0000 7fc7d27fc6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc7c00b56d0 0x7fc7c00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:28.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.224+0000 7fc7d27fc6c0 1 -- 10.20.193.40:0/2270078255 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fc7e0108c90 con 0x7fc7e4126b90 2026-02-13T01:27:28.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.224+0000 7fc7e94cd6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc7c00b56d0 0x7fc7c00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:28.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.224+0000 7fc7d27fc6c0 1 -- 10.20.193.40:0/2270078255 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc7e0109180 con 0x7fc7e4126b90 2026-02-13T01:27:28.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.224+0000 7fc7e94cd6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc7c00b56d0 0x7fc7c00d5b80 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7d4004750 tx=0x7fc7d4009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:28.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.352+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc7e4113b70 con 0x7fc7e4126b90 2026-02-13T01:27:28.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.352+0000 7fc7d27fc6c0 1 -- 10.20.193.40:0/2270078255 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc7e00cb670 con 0x7fc7e4126b90 2026-02-13T01:27:28.354 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:28.354 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:28.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc7c00b56d0 msgr2=0x7fc7c00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:28.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc7c00b56d0 0x7fc7c00d5b80 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7d4004750 tx=0x7fc7d4009260 comp rx=0 tx=0).stop 2026-02-13T01:27:28.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4126b90 msgr2=0x7fc7e4127030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:28.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4126b90 0x7fc7e4127030 secure :-1 s=READY pgs=338 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7e000ab70 tx=0x7fc7e0032f60 comp rx=0 tx=0).stop 2026-02-13T01:27:28.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 shutdown_connections 2026-02-13T01:27:28.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc7c00b56d0 0x7fc7c00d5b80 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7e4126b90 0x7fc7e4127030 unknown :-1 s=CLOSED pgs=338 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc7e4116520 0x7fc7e4121820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 --2- 10.20.193.40:0/2270078255 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc7e41137a0 0x7fc7e41212e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:28.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 >> 10.20.193.40:0/2270078255 conn(0x7fc7e4061510 msgr2=0x7fc7e4115520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:28.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 shutdown_connections 2026-02-13T01:27:28.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:28.354+0000 7fc7ea4cf6c0 1 -- 10.20.193.40:0/2270078255 wait complete. 2026-02-13T01:27:28.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:28 trial055 ceph-mon[27509]: pgmap v290: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:28.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:28 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2270078255' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:28.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:28 trial040 ceph-mon[23046]: pgmap v290: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:28.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:28 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2270078255' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:29.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:28 trial118 ceph-mon[27812]: pgmap v290: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:29.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:28 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2270078255' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:30.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:30 trial055 ceph-mon[27509]: pgmap v291: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:30.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:30 trial040 ceph-mon[23046]: pgmap v291: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:31.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:30 trial118 ceph-mon[27812]: pgmap v291: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:31.456 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:31.642 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:31.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.841+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/3662696448 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffbb010fa50 msgr2=0x7ffbb0114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:31.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.841+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/3662696448 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffbb010fa50 0x7ffbb0114a90 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=17367694114528281481 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb980099a0 tx=0x7ffb9802ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:31.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.841+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/3662696448 shutdown_connections 2026-02-13T01:27:31.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.841+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/3662696448 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffbb0115270 0x7ffbb0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:31.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.841+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/3662696448 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffbb010fa50 0x7ffbb0114a90 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=17367694114528281481 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:31.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.841+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/3662696448 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffbb010f060 0x7ffbb010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:31.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.841+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/3662696448 >> 10.20.193.40:0/3662696448 conn(0x7ffbb00ec980 msgr2=0x7ffbb010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:31.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.841+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/3662696448 shutdown_connections 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.841+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/3662696448 wait complete. 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbaf5776c0 1 Processor -- start 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbaf5776c0 1 -- start start 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbaf5776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffbb010f060 0x7ffbb011cf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbaf5776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffbb0115270 0x7ffbb011d450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbaf5776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffbb0122810 0x7ffbb0122cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbaf5776c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb0123220 con 0x7ffbb0122810 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbaf5776c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb0123390 con 0x7ffbb010f060 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbaf5776c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb0123550 con 0x7ffbb0115270 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbae5756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffbb010f060 0x7ffbb011cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbadd746c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffbb0115270 0x7ffbb011d450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:31.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbae5756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffbb010f060 0x7ffbb011cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:40506/0 (socket says 10.20.193.40:40506) 2026-02-13T01:27:31.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbae5756c0 1 -- 10.20.193.40:0/2338215319 learned_addr learned my addr 10.20.193.40:0/2338215319 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:31.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.842+0000 7ffbaed766c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffbb0122810 0x7ffbb0122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:31.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffbaed766c0 1 -- 10.20.193.40:0/2338215319 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffbb0115270 msgr2=0x7ffbb011d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:31.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffbaed766c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffbb0115270 0x7ffbb011d450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:31.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffbaed766c0 1 -- 10.20.193.40:0/2338215319 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffbb010f060 msgr2=0x7ffbb011cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:31.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffbaed766c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffbb010f060 0x7ffbb011cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:31.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffbaed766c0 1 -- 10.20.193.40:0/2338215319 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb98009590 con 0x7ffbb0122810 2026-02-13T01:27:31.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffbae5756c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffbb010f060 0x7ffbb011cf10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:27:31.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffbaed766c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffbb0122810 0x7ffbb0122cb0 secure :-1 s=READY pgs=340 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffba000c6c0 tx=0x7ffba000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:31.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffb977fe6c0 1 -- 10.20.193.40:0/2338215319 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffba0005340 con 0x7ffbb0122810 2026-02-13T01:27:31.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffb977fe6c0 1 -- 10.20.193.40:0/2338215319 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ffba0003d40 con 0x7ffbb0122810 2026-02-13T01:27:31.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffb977fe6c0 1 -- 10.20.193.40:0/2338215319 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffba000de30 con 0x7ffbb0122810 2026-02-13T01:27:31.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb0163a00 con 0x7ffbb0122810 2026-02-13T01:27:31.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.843+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb0163e90 con 0x7ffbb0122810 2026-02-13T01:27:31.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.844+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb0110330 con 0x7ffbb0122810 2026-02-13T01:27:31.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.846+0000 7ffb977fe6c0 1 -- 10.20.193.40:0/2338215319 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ffba000d410 con 0x7ffbb0122810 2026-02-13T01:27:31.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.848+0000 7ffb977fe6c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffb880b5650 0x7ffb880d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:31.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.848+0000 7ffb977fe6c0 1 -- 10.20.193.40:0/2338215319 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7ffba00e4a40 con 0x7ffbb0122810 2026-02-13T01:27:31.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.848+0000 7ffbae5756c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffb880b5650 0x7ffb880d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:31.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.848+0000 7ffb977fe6c0 1 -- 10.20.193.40:0/2338215319 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffba011d5e0 con 0x7ffbb0122810 2026-02-13T01:27:31.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.848+0000 7ffbae5756c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffb880b5650 0x7ffb880d5b00 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffba4009240 tx=0x7ffba4009420 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:31.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.971+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffbb010fa50 con 0x7ffbb0122810 2026-02-13T01:27:31.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.971+0000 7ffb977fe6c0 1 -- 10.20.193.40:0/2338215319 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ffba00a73e0 con 0x7ffbb0122810 2026-02-13T01:27:31.973 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:31.973 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:31.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffb880b5650 msgr2=0x7ffb880d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:31.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffb880b5650 0x7ffb880d5b00 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffba4009240 tx=0x7ffba4009420 comp rx=0 tx=0).stop 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffbb0122810 msgr2=0x7ffbb0122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffbb0122810 0x7ffbb0122cb0 secure :-1 s=READY pgs=340 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffba000c6c0 tx=0x7ffba000cb90 comp rx=0 tx=0).stop 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 shutdown_connections 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7ffb880b5650 0x7ffb880d5b00 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffbb0122810 0x7ffbb0122cb0 unknown :-1 s=CLOSED pgs=340 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7ffbb0115270 0x7ffbb011d450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 --2- 10.20.193.40:0/2338215319 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7ffbb010f060 0x7ffbb011cf10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 >> 10.20.193.40:0/2338215319 conn(0x7ffbb00ec980 msgr2=0x7ffbb010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 shutdown_connections 2026-02-13T01:27:31.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:31.973+0000 7ffbaf5776c0 1 -- 10.20.193.40:0/2338215319 wait complete. 2026-02-13T01:27:32.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:32 trial040 ceph-mon[23046]: pgmap v292: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:32.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:32 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2338215319' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:33.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:32 trial118 ceph-mon[27812]: pgmap v292: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:33.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:32 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2338215319' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:33.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:32 trial055 ceph-mon[27509]: pgmap v292: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:33.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:32 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2338215319' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:34.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:34 trial040 ceph-mon[23046]: pgmap v293: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:35.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:34 trial118 ceph-mon[27812]: pgmap v293: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:35.077 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:35.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:34 trial055 ceph-mon[27509]: pgmap v293: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:35.261 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:35.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.466+0000 7f0029ea76c0 1 -- 10.20.193.40:0/1946782087 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f002410c1c0 msgr2=0x7f00241550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:35.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.466+0000 7f0029ea76c0 1 --2- 10.20.193.40:0/1946782087 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f002410c1c0 0x7f00241550a0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=10770198898514325688 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f000c009970 tx=0x7f000c02ed10 comp rx=0 tx=0).stop 2026-02-13T01:27:35.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.466+0000 7f0029ea76c0 1 -- 10.20.193.40:0/1946782087 shutdown_connections 2026-02-13T01:27:35.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.466+0000 7f0029ea76c0 1 --2- 10.20.193.40:0/1946782087 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f00241555e0 0x7f00241759c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:35.468 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.466+0000 7f0029ea76c0 1 --2- 10.20.193.40:0/1946782087 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f002410c1c0 0x7f00241550a0 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=10770198898514325688 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:35.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.466+0000 7f0029ea76c0 1 --2- 10.20.193.40:0/1946782087 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f002410b8b0 0x7f002410bc80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:35.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.466+0000 7f0029ea76c0 1 -- 10.20.193.40:0/1946782087 >> 10.20.193.40:0/1946782087 conn(0x7f00240e9590 msgr2=0x7f00241099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:35.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.466+0000 7f0029ea76c0 1 -- 10.20.193.40:0/1946782087 shutdown_connections 2026-02-13T01:27:35.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.466+0000 7f0029ea76c0 1 -- 10.20.193.40:0/1946782087 wait complete. 2026-02-13T01:27:35.469 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.467+0000 7f0029ea76c0 1 Processor -- start 2026-02-13T01:27:35.471 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.467+0000 7f0029ea76c0 1 -- start start 2026-02-13T01:27:35.471 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.467+0000 7f0029ea76c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f002410b8b0 0x7f0024160170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:35.471 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.467+0000 7f0029ea76c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f002410c1c0 0x7f00241606b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:35.471 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.467+0000 7f0029ea76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00241555e0 0x7f0024165a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:35.471 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.467+0000 7f0029ea76c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f00241660c0 con 0x7f00241555e0 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.467+0000 7f0029ea76c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0024166230 con 0x7f002410c1c0 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.467+0000 7f0029ea76c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f00241663f0 con 0x7f002410b8b0 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f001bfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f002410c1c0 0x7f00241606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f001bfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f002410c1c0 0x7f00241606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:40520/0 (socket says 10.20.193.40:40520) 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f001bfff6c0 1 -- 10.20.193.40:0/576137696 learned_addr learned my addr 10.20.193.40:0/576137696 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f00296a66c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00241555e0 0x7f0024165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f0028ea56c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f002410b8b0 0x7f0024160170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f001bfff6c0 1 -- 10.20.193.40:0/576137696 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f002410b8b0 msgr2=0x7f0024160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f001bfff6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f002410b8b0 0x7f0024160170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f001bfff6c0 1 -- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00241555e0 msgr2=0x7f0024165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f001bfff6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00241555e0 0x7f0024165a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:35.472 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f001bfff6c0 1 -- 10.20.193.40:0/576137696 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c009590 con 0x7f002410c1c0 2026-02-13T01:27:35.473 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f001bfff6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f002410c1c0 0x7f00241606b0 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f000c005ae0 tx=0x7f000c02f820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:35.473 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f0019ffb6c0 1 -- 10.20.193.40:0/576137696 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f000c0046b0 con 0x7f002410c1c0 2026-02-13T01:27:35.473 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f0019ffb6c0 1 -- 10.20.193.40:0/576137696 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f000c002be0 con 0x7f002410c1c0 2026-02-13T01:27:35.473 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f0029ea76c0 1 -- 10.20.193.40:0/576137696 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0024166670 con 0x7f002410c1c0 2026-02-13T01:27:35.473 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f0019ffb6c0 1 -- 10.20.193.40:0/576137696 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f000c0073f0 con 0x7f002410c1c0 2026-02-13T01:27:35.473 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.468+0000 7f0029ea76c0 1 -- 10.20.193.40:0/576137696 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0024152220 con 0x7f002410c1c0 2026-02-13T01:27:35.473 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.469+0000 7efff37fe6c0 1 -- 10.20.193.40:0/576137696 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002405fb30 con 0x7f002410c1c0 2026-02-13T01:27:35.474 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.471+0000 7f0019ffb6c0 1 -- 10.20.193.40:0/576137696 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f000c031270 con 0x7f002410c1c0 2026-02-13T01:27:35.474 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.472+0000 7f0019ffb6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f00000b5650 0x7f00000d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:35.474 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.473+0000 7f0019ffb6c0 1 -- 10.20.193.40:0/576137696 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f000c107ee0 con 0x7f002410c1c0 2026-02-13T01:27:35.474 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.473+0000 7f0028ea56c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f00000b5650 0x7f00000d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:35.474 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.473+0000 7f0019ffb6c0 1 -- 10.20.193.40:0/576137696 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f000c108360 con 0x7f002410c1c0 2026-02-13T01:27:35.475 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.473+0000 7f0028ea56c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f00000b5650 0x7f00000d5b00 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0014005980 tx=0x7f0014005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:35.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.598+0000 7efff37fe6c0 1 -- 10.20.193.40:0/576137696 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f00241612c0 con 0x7f002410c1c0 2026-02-13T01:27:35.600 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.598+0000 7f0019ffb6c0 1 -- 10.20.193.40:0/576137696 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f000c0ca880 con 0x7f002410c1c0 2026-02-13T01:27:35.600 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:35.600 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:35.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.599+0000 7efff37fe6c0 1 -- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f00000b5650 msgr2=0x7f00000d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:35.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.599+0000 7efff37fe6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f00000b5650 0x7f00000d5b00 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0014005980 tx=0x7f0014005910 comp rx=0 tx=0).stop 2026-02-13T01:27:35.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.599+0000 7efff37fe6c0 1 -- 10.20.193.40:0/576137696 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f002410c1c0 msgr2=0x7f00241606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:35.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.599+0000 7efff37fe6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f002410c1c0 0x7f00241606b0 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f000c005ae0 tx=0x7f000c02f820 comp rx=0 tx=0).stop 2026-02-13T01:27:35.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.600+0000 7efff37fe6c0 1 -- 10.20.193.40:0/576137696 shutdown_connections 2026-02-13T01:27:35.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.600+0000 7efff37fe6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f00000b5650 0x7f00000d5b00 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:35.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.600+0000 7efff37fe6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00241555e0 0x7f0024165a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:35.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.600+0000 7efff37fe6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f002410c1c0 0x7f00241606b0 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:35.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.600+0000 7efff37fe6c0 1 --2- 10.20.193.40:0/576137696 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f002410b8b0 0x7f0024160170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:35.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.600+0000 7efff37fe6c0 1 -- 10.20.193.40:0/576137696 >> 10.20.193.40:0/576137696 conn(0x7f00240e9590 msgr2=0x7f0024109970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:35.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.600+0000 7efff37fe6c0 1 -- 10.20.193.40:0/576137696 shutdown_connections 2026-02-13T01:27:35.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:35.600+0000 7efff37fe6c0 1 -- 10.20.193.40:0/576137696 wait complete. 2026-02-13T01:27:35.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:35 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/576137696' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:36.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:35 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/576137696' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:36.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:35 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/576137696' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:37.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:36 trial118 ceph-mon[27812]: pgmap v294: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:37.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:36 trial055 ceph-mon[27509]: pgmap v294: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:37.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:36 trial040 ceph-mon[23046]: pgmap v294: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:38.706 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:38.891 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:39.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:38 trial118 ceph-mon[27812]: pgmap v295: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:39.021 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:38 trial040 ceph-mon[23046]: pgmap v295: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:39.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/1351348371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f409c10c680 msgr2=0x7f409c1116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:39.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/1351348371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f409c10c680 0x7f409c1116c0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=13999925433932570806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40900099a0 tx=0x7f409002ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:39.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/1351348371 shutdown_connections 2026-02-13T01:27:39.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/1351348371 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f409c111ea0 0x7f409c172840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/1351348371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f409c10c680 0x7f409c1116c0 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=13999925433932570806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/1351348371 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f409c10bc90 0x7f409c10c060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/1351348371 >> 10.20.193.40:0/1351348371 conn(0x7f409c0e9590 msgr2=0x7f409c1099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:39.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/1351348371 shutdown_connections 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/1351348371 wait complete. 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.079+0000 7f40a31ab6c0 1 Processor -- start 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a31ab6c0 1 -- start start 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a31ab6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f409c10bc90 0x7f409c0f4780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a31ab6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f409c111ea0 0x7f409c172740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a31ab6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f409c0f4db0 0x7f409c0fa080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a31ab6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f409c0f54a0 con 0x7f409c0f4db0 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a31ab6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f409c0fa5c0 con 0x7f409c111ea0 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a31ab6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f409c0fa780 con 0x7f409c10bc90 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a21a96c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f409c10bc90 0x7f409c0f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:39.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a21a96c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f409c10bc90 0x7f409c0f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:59062/0 (socket says 10.20.193.40:59062) 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a21a96c0 1 -- 10.20.193.40:0/2051984531 learned_addr learned my addr 10.20.193.40:0/2051984531 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a29aa6c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f409c0f4db0 0x7f409c0fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a19a86c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f409c111ea0 0x7f409c172740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a21a96c0 1 -- 10.20.193.40:0/2051984531 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f409c111ea0 msgr2=0x7f409c172740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a21a96c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f409c111ea0 0x7f409c172740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a21a96c0 1 -- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f409c0f4db0 msgr2=0x7f409c0fa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a21a96c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f409c0f4db0 0x7f409c0fa080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a21a96c0 1 -- 10.20.193.40:0/2051984531 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4090009590 con 0x7f409c10bc90 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.080+0000 7f40a29aa6c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f409c0f4db0 0x7f409c0fa080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:27:39.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.081+0000 7f40a21a96c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f409c10bc90 0x7f409c0f4780 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f408c00b7b0 tx=0x7f408c00bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:39.085 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.081+0000 7f40837fe6c0 1 -- 10.20.193.40:0/2051984531 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f408c004a80 con 0x7f409c10bc90 2026-02-13T01:27:39.085 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.081+0000 7f40837fe6c0 1 -- 10.20.193.40:0/2051984531 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f408c009030 con 0x7f409c10bc90 2026-02-13T01:27:39.085 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.081+0000 7f40837fe6c0 1 -- 10.20.193.40:0/2051984531 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f408c0071c0 con 0x7f409c10bc90 2026-02-13T01:27:39.085 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.081+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409c0faa60 con 0x7f409c10bc90 2026-02-13T01:27:39.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.081+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409c0faef0 con 0x7f409c10bc90 2026-02-13T01:27:39.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.082+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409c10cf60 con 0x7f409c10bc90 2026-02-13T01:27:39.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.084+0000 7f40837fe6c0 1 -- 10.20.193.40:0/2051984531 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f408c005000 con 0x7f409c10bc90 2026-02-13T01:27:39.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.085+0000 7f40837fe6c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40780b5650 0x7f40780d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:39.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.085+0000 7f40837fe6c0 1 -- 10.20.193.40:0/2051984531 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f408c0e39b0 con 0x7f409c10bc90 2026-02-13T01:27:39.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.086+0000 7f40837fe6c0 1 -- 10.20.193.40:0/2051984531 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f408c0e3e30 con 0x7f409c10bc90 2026-02-13T01:27:39.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.086+0000 7f40a19a86c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40780b5650 0x7f40780d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:39.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.086+0000 7f40a19a86c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40780b5650 0x7f40780d5b00 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f409c0fb110 tx=0x7f40900023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:39.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.209+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f409c0f5900 con 0x7f409c10bc90 2026-02-13T01:27:39.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.209+0000 7f40837fe6c0 1 -- 10.20.193.40:0/2051984531 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f408c0a6350 con 0x7f409c10bc90 2026-02-13T01:27:39.210 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:39.211 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:39.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40780b5650 msgr2=0x7f40780d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40780b5650 0x7f40780d5b00 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f409c0fb110 tx=0x7f40900023a0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f409c10bc90 msgr2=0x7f409c0f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f409c10bc90 0x7f409c0f4780 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f408c00b7b0 tx=0x7f408c00bc80 comp rx=0 tx=0).stop 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 shutdown_connections 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f40780b5650 0x7f40780d5b00 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f409c0f4db0 0x7f409c0fa080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f409c111ea0 0x7f409c172740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 --2- 10.20.193.40:0/2051984531 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f409c10bc90 0x7f409c0f4780 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 >> 10.20.193.40:0/2051984531 conn(0x7f409c0e9590 msgr2=0x7f409c10a150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 shutdown_connections 2026-02-13T01:27:39.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:39.210+0000 7f40a31ab6c0 1 -- 10.20.193.40:0/2051984531 wait complete. 2026-02-13T01:27:39.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:38 trial055 ceph-mon[27509]: pgmap v295: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:40.142 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:39 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2051984531' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:40.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:39 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2051984531' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:40.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:39 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2051984531' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:41.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:40 trial055 ceph-mon[27509]: pgmap v296: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:41.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:40 trial040 ceph-mon[23046]: pgmap v296: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:41.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:40 trial118 ceph-mon[27812]: pgmap v296: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:42.314 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:42.497 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:42.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.693+0000 7f797d34b6c0 1 -- 10.20.193.40:0/3105594878 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7978115270 msgr2=0x7f7978175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:42.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.693+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/3105594878 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7978115270 0x7f7978175c10 secure :-1 s=READY pgs=343 gs=2 cs=0 l=1 c_cookie=3225874366285422058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f796c00aa70 tx=0x7f796c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.694+0000 7f797d34b6c0 1 -- 10.20.193.40:0/3105594878 shutdown_connections 2026-02-13T01:27:42.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.694+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/3105594878 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7978115270 0x7f7978175c10 unknown :-1 s=CLOSED pgs=343 gs=2 cs=0 l=1 c_cookie=3225874366285422058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.694+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/3105594878 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f797810fa50 0x7f7978114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.694+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/3105594878 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f797810f060 0x7f797810f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.694+0000 7f797d34b6c0 1 -- 10.20.193.40:0/3105594878 >> 10.20.193.40:0/3105594878 conn(0x7f79780ec980 msgr2=0x7f797810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:42.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.694+0000 7f797d34b6c0 1 -- 10.20.193.40:0/3105594878 shutdown_connections 2026-02-13T01:27:42.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.694+0000 7f797d34b6c0 1 -- 10.20.193.40:0/3105594878 wait complete. 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f797d34b6c0 1 Processor -- start 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f797d34b6c0 1 -- start start 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f797d34b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f797810f060 0x7f797811cea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f797d34b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7978115270 0x7f797811d3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f797d34b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79781227a0 0x7f7978122c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f797d34b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f79781231b0 con 0x7f797810f060 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f797d34b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7978123320 con 0x7f79781227a0 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f797d34b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79781234e0 con 0x7f7978115270 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f7977fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f797810f060 0x7f797811cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f79777fe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7978115270 0x7f797811d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f7977fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f797810f060 0x7f797811cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47616/0 (socket says 10.20.193.40:47616) 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f7977fff6c0 1 -- 10.20.193.40:0/2381983829 learned_addr learned my addr 10.20.193.40:0/2381983829 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:42.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.695+0000 7f797cb4a6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79781227a0 0x7f7978122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f7977fff6c0 1 -- 10.20.193.40:0/2381983829 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7978115270 msgr2=0x7f797811d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f7977fff6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7978115270 0x7f797811d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f7977fff6c0 1 -- 10.20.193.40:0/2381983829 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79781227a0 msgr2=0x7f7978122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f7977fff6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79781227a0 0x7f7978122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f7977fff6c0 1 -- 10.20.193.40:0/2381983829 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796c00a660 con 0x7f797810f060 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f7977fff6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f797810f060 0x7f797811cea0 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7964009490 tx=0x7f796400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f79757fa6c0 1 -- 10.20.193.40:0/2381983829 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7964004a80 con 0x7f797810f060 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f79757fa6c0 1 -- 10.20.193.40:0/2381983829 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7964009030 con 0x7f797810f060 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f79757fa6c0 1 -- 10.20.193.40:0/2381983829 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7964007440 con 0x7f797810f060 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7978163990 con 0x7f797810f060 2026-02-13T01:27:42.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.696+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7978163e20 con 0x7f797810f060 2026-02-13T01:27:42.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.697+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7978110330 con 0x7f797810f060 2026-02-13T01:27:42.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.699+0000 7f79757fa6c0 1 -- 10.20.193.40:0/2381983829 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f79640075d0 con 0x7f797810f060 2026-02-13T01:27:42.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.700+0000 7f79757fa6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f794c0b56d0 0x7f794c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:42.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.700+0000 7f79757fa6c0 1 -- 10.20.193.40:0/2381983829 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f79640e3b20 con 0x7f797810f060 2026-02-13T01:27:42.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.701+0000 7f79777fe6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f794c0b56d0 0x7f794c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:42.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.701+0000 7f79757fa6c0 1 -- 10.20.193.40:0/2381983829 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f796411c5e0 con 0x7f797810f060 2026-02-13T01:27:42.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.701+0000 7f79777fe6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f794c0b56d0 0x7f794c0d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7978123830 tx=0x7f7968009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:42.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.824+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f797811dff0 con 0x7f797810f060 2026-02-13T01:27:42.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.824+0000 7f79757fa6c0 1 -- 10.20.193.40:0/2381983829 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f79640a64c0 con 0x7f797810f060 2026-02-13T01:27:42.826 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:42.826 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:42.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f794c0b56d0 msgr2=0x7f794c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:42.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f794c0b56d0 0x7f794c0d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7978123830 tx=0x7f7968009260 comp rx=0 tx=0).stop 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f797810f060 msgr2=0x7f797811cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f797810f060 0x7f797811cea0 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7964009490 tx=0x7f796400bca0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 shutdown_connections 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f794c0b56d0 0x7f794c0d5b80 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f79781227a0 0x7f7978122c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7978115270 0x7f797811d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 --2- 10.20.193.40:0/2381983829 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f797810f060 0x7f797811cea0 unknown :-1 s=CLOSED pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 >> 10.20.193.40:0/2381983829 conn(0x7f79780ec980 msgr2=0x7f797810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 shutdown_connections 2026-02-13T01:27:42.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:42.826+0000 7f797d34b6c0 1 -- 10.20.193.40:0/2381983829 wait complete. 2026-02-13T01:27:42.886 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:42 trial040 ceph-mon[23046]: pgmap v297: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:43.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:42 trial055 ceph-mon[27509]: pgmap v297: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:43.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:42 trial118 ceph-mon[27812]: pgmap v297: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:44.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:43 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2381983829' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:44.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:43 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2381983829' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:44.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:43 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2381983829' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:45.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:44 trial055 ceph-mon[27509]: pgmap v298: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:45.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:44 trial040 ceph-mon[23046]: pgmap v298: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:45.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:44 trial118 ceph-mon[27812]: pgmap v298: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:45.929 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:46.112 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:46.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.300+0000 7f017c3356c0 1 -- 10.20.193.40:0/1961309040 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 msgr2=0x7f0174175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:46.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.300+0000 7f017c3356c0 1 --2- 10.20.193.40:0/1961309040 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 0x7f0174175db0 secure :-1 s=READY pgs=345 gs=3 cs=0 l=1 c_cookie=12949235191787544099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f017000aa70 tx=0x7f017002fdd0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.300+0000 7f017c3356c0 1 -- 10.20.193.40:0/1961309040 shutdown_connections 2026-02-13T01:27:46.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.300+0000 7f017c3356c0 1 --2- 10.20.193.40:0/1961309040 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 0x7f0174175db0 unknown :-1 s=CLOSED pgs=345 gs=3 cs=0 l=1 c_cookie=12949235191787544099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.300+0000 7f017c3356c0 1 --2- 10.20.193.40:0/1961309040 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f017410fbf0 0x7f0174114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.300+0000 7f017c3356c0 1 --2- 10.20.193.40:0/1961309040 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f017410f200 0x7f017410f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.300+0000 7f017c3356c0 1 -- 10.20.193.40:0/1961309040 >> 10.20.193.40:0/1961309040 conn(0x7f01740ecb00 msgr2=0x7f017410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:46.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.300+0000 7f017c3356c0 1 -- 10.20.193.40:0/1961309040 shutdown_connections 2026-02-13T01:27:46.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.300+0000 7f017c3356c0 1 -- 10.20.193.40:0/1961309040 wait complete. 2026-02-13T01:27:46.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017c3356c0 1 Processor -- start 2026-02-13T01:27:46.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017c3356c0 1 -- start start 2026-02-13T01:27:46.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017c3356c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f017410f200 0x7f017411cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:46.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017c3356c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 0x7f017411d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:46.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017c3356c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0174122860 0x7f0174122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017c3356c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0174123270 con 0x7f0174115410 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017c3356c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f01741233e0 con 0x7f017410f200 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017c3356c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f01741235a0 con 0x7f0174122860 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f01798a56c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 0x7f017411d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017a0a66c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f017410f200 0x7f017411cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f01798a56c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 0x7f017411d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47638/0 (socket says 10.20.193.40:47638) 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f01798a56c0 1 -- 10.20.193.40:0/3252915466 learned_addr learned my addr 10.20.193.40:0/3252915466 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f017a8a76c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0174122860 0x7f0174122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f01798a56c0 1 -- 10.20.193.40:0/3252915466 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0174122860 msgr2=0x7f0174122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f01798a56c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0174122860 0x7f0174122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f01798a56c0 1 -- 10.20.193.40:0/3252915466 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f017410f200 msgr2=0x7f017411cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:46.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f01798a56c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f017410f200 0x7f017411cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.301+0000 7f01798a56c0 1 -- 10.20.193.40:0/3252915466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017000a660 con 0x7f0174115410 2026-02-13T01:27:46.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.302+0000 7f01798a56c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 0x7f017411d4a0 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f016800b800 tx=0x7f016800bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:46.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.302+0000 7f015b7fe6c0 1 -- 10.20.193.40:0/3252915466 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0168004a80 con 0x7f0174115410 2026-02-13T01:27:46.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.302+0000 7f015b7fe6c0 1 -- 10.20.193.40:0/3252915466 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0168009070 con 0x7f0174115410 2026-02-13T01:27:46.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.302+0000 7f015b7fe6c0 1 -- 10.20.193.40:0/3252915466 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01680071c0 con 0x7f0174115410 2026-02-13T01:27:46.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.302+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0174163a50 con 0x7f0174115410 2026-02-13T01:27:46.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.302+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0174163ee0 con 0x7f0174115410 2026-02-13T01:27:46.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.302+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01741104d0 con 0x7f0174115410 2026-02-13T01:27:46.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.305+0000 7f015b7fe6c0 1 -- 10.20.193.40:0/3252915466 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0168005000 con 0x7f0174115410 2026-02-13T01:27:46.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.307+0000 7f015b7fe6c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01500b57a0 0x7f01500d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:46.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.307+0000 7f015b7fe6c0 1 -- 10.20.193.40:0/3252915466 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f01680e3a90 con 0x7f0174115410 2026-02-13T01:27:46.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.307+0000 7f017a0a66c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01500b57a0 0x7f01500d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:46.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.307+0000 7f015b7fe6c0 1 -- 10.20.193.40:0/3252915466 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f016811c5e0 con 0x7f0174115410 2026-02-13T01:27:46.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.307+0000 7f017a0a66c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01500b57a0 0x7f01500d5c50 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0164004750 tx=0x7f0164009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:46.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.432+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f017410f5d0 con 0x7f0174115410 2026-02-13T01:27:46.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.432+0000 7f015b7fe6c0 1 -- 10.20.193.40:0/3252915466 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f01680a6430 con 0x7f0174115410 2026-02-13T01:27:46.434 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:46.434 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:46.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01500b57a0 msgr2=0x7f01500d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:46.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01500b57a0 0x7f01500d5c50 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0164004750 tx=0x7f0164009260 comp rx=0 tx=0).stop 2026-02-13T01:27:46.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 msgr2=0x7f017411d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:46.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 0x7f017411d4a0 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f016800b800 tx=0x7f016800bcd0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 shutdown_connections 2026-02-13T01:27:46.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f01500b57a0 0x7f01500d5c50 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0174122860 0x7f0174122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0174115410 0x7f017411d4a0 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 --2- 10.20.193.40:0/3252915466 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f017410f200 0x7f017411cf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:46.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 >> 10.20.193.40:0/3252915466 conn(0x7f01740ecb00 msgr2=0x7f017410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:46.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 shutdown_connections 2026-02-13T01:27:46.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:46.433+0000 7f017c3356c0 1 -- 10.20.193.40:0/3252915466 wait complete. 2026-02-13T01:27:47.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:46 trial055 ceph-mon[27509]: pgmap v299: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:47.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:46 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3252915466' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:47.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:46 trial040 ceph-mon[23046]: pgmap v299: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:47.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:46 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3252915466' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:47.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:46 trial118 ceph-mon[27812]: pgmap v299: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:47.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:46 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3252915466' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:49.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:48 trial055 ceph-mon[27509]: pgmap v300: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:49.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:48 trial040 ceph-mon[23046]: pgmap v300: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:49.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:48 trial118 ceph-mon[27812]: pgmap v300: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:49.574 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:49.759 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:49.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.949+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/3798773336 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f32a410f060 msgr2=0x7f32a410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:49.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.949+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/3798773336 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f32a410f060 0x7f32a410f430 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=2853273700335129866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3298009970 tx=0x7f329802ed50 comp rx=0 tx=0).stop 2026-02-13T01:27:49.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.949+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/3798773336 shutdown_connections 2026-02-13T01:27:49.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.949+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/3798773336 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f32a4115270 0x7f32a4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:49.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.949+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/3798773336 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32a410fa50 0x7f32a4114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:49.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.949+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/3798773336 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f32a410f060 0x7f32a410f430 unknown :-1 s=CLOSED pgs=113 gs=2 cs=0 l=1 c_cookie=2853273700335129866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:49.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.949+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/3798773336 >> 10.20.193.40:0/3798773336 conn(0x7f32a40ec980 msgr2=0x7f32a410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:49.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.949+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/3798773336 shutdown_connections 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.949+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/3798773336 wait complete. 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.950+0000 7f32a3fff6c0 1 Processor -- start 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.950+0000 7f32a3fff6c0 1 -- start start 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.950+0000 7f32a3fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f32a410f060 0x7f32a40f8c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.950+0000 7f32a3fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f32a4115270 0x7f32a4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a3fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32a40f9250 0x7f32a40fe520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a3fff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f32a40f9940 con 0x7f32a40f9250 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a3fff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f32a40fea60 con 0x7f32a4115270 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a3fff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f32a40fec20 con 0x7f32a410f060 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a37fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32a40f9250 0x7f32a40fe520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a27fc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f32a4115270 0x7f32a4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:49.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a37fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32a40f9250 0x7f32a40fe520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:47652/0 (socket says 10.20.193.40:47652) 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a37fe6c0 1 -- 10.20.193.40:0/2896162679 learned_addr learned my addr 10.20.193.40:0/2896162679 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a27fc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f32a4115270 0x7f32a4175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:45434/0 (socket says 10.20.193.40:45434) 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a2ffd6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f32a410f060 0x7f32a40f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a37fe6c0 1 -- 10.20.193.40:0/2896162679 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f32a410f060 msgr2=0x7f32a40f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a37fe6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f32a410f060 0x7f32a40f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a37fe6c0 1 -- 10.20.193.40:0/2896162679 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f32a4115270 msgr2=0x7f32a4175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a37fe6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f32a4115270 0x7f32a4175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a37fe6c0 1 -- 10.20.193.40:0/2896162679 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328c0094c0 con 0x7f32a40f9250 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a37fe6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32a40f9250 0x7f32a40fe520 secure :-1 s=READY pgs=347 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3294006ea0 tx=0x7f329400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f3283fff6c0 1 -- 10.20.193.40:0/2896162679 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3294003c40 con 0x7f32a40f9250 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3298009590 con 0x7f32a40f9250 2026-02-13T01:27:49.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f3283fff6c0 1 -- 10.20.193.40:0/2896162679 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3294003da0 con 0x7f32a40f9250 2026-02-13T01:27:49.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f3283fff6c0 1 -- 10.20.193.40:0/2896162679 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3294008440 con 0x7f32a40f9250 2026-02-13T01:27:49.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.951+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a40ff250 con 0x7f32a40f9250 2026-02-13T01:27:49.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.952+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a4110330 con 0x7f32a40f9250 2026-02-13T01:27:49.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.954+0000 7f3283fff6c0 1 -- 10.20.193.40:0/2896162679 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f329400d690 con 0x7f32a40f9250 2026-02-13T01:27:49.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.956+0000 7f3283fff6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f32780b56d0 0x7f32780d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:49.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.956+0000 7f3283fff6c0 1 -- 10.20.193.40:0/2896162679 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f32940e4b90 con 0x7f32a40f9250 2026-02-13T01:27:49.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.956+0000 7f32a2ffd6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f32780b56d0 0x7f32780d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:49.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.956+0000 7f3283fff6c0 1 -- 10.20.193.40:0/2896162679 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f329411d600 con 0x7f32a40f9250 2026-02-13T01:27:49.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:49.957+0000 7f32a2ffd6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f32780b56d0 0x7f32780d5b80 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32980098c0 tx=0x7f32980023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:50.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.080+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f32a410f430 con 0x7f32a40f9250 2026-02-13T01:27:50.082 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.081+0000 7f3283fff6c0 1 -- 10.20.193.40:0/2896162679 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f32940a7530 con 0x7f32a40f9250 2026-02-13T01:27:50.082 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:50.083 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:50.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f32780b56d0 msgr2=0x7f32780d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:50.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f32780b56d0 0x7f32780d5b80 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32980098c0 tx=0x7f32980023a0 comp rx=0 tx=0).stop 2026-02-13T01:27:50.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32a40f9250 msgr2=0x7f32a40fe520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:50.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32a40f9250 0x7f32a40fe520 secure :-1 s=READY pgs=347 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3294006ea0 tx=0x7f329400ce50 comp rx=0 tx=0).stop 2026-02-13T01:27:50.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 shutdown_connections 2026-02-13T01:27:50.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f32780b56d0 0x7f32780d5b80 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:50.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32a40f9250 0x7f32a40fe520 unknown :-1 s=CLOSED pgs=347 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:50.084 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f32a4115270 0x7f32a4175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:50.085 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 --2- 10.20.193.40:0/2896162679 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f32a410f060 0x7f32a40f8c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:50.085 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 >> 10.20.193.40:0/2896162679 conn(0x7f32a40ec980 msgr2=0x7f32a4111910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:50.085 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 shutdown_connections 2026-02-13T01:27:50.085 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:50.082+0000 7f32a3fff6c0 1 -- 10.20.193.40:0/2896162679 wait complete. 2026-02-13T01:27:51.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:50 trial055 ceph-mon[27509]: pgmap v301: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:51.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:50 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2896162679' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:50 trial040 ceph-mon[23046]: pgmap v301: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:51.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:50 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2896162679' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:51.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:50 trial118 ceph-mon[27812]: pgmap v301: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:51.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:50 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2896162679' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:53.188 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:53.241 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:52 trial040 ceph-mon[23046]: pgmap v302: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:53.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:52 trial055 ceph-mon[27509]: pgmap v302: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:53.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:52 trial118 ceph-mon[27812]: pgmap v302: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:53.374 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:53.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.569+0000 7f0b594356c0 1 -- 10.20.193.40:0/3521779343 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b541146d0 msgr2=0x7f0b5415bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:53.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.569+0000 7f0b594356c0 1 --2- 10.20.193.40:0/3521779343 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b541146d0 0x7f0b5415bab0 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=5390287783508174496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b3c009970 tx=0x7f0b3c02ed50 comp rx=0 tx=0).stop 2026-02-13T01:27:53.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.569+0000 7f0b594356c0 1 -- 10.20.193.40:0/3521779343 shutdown_connections 2026-02-13T01:27:53.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.569+0000 7f0b594356c0 1 --2- 10.20.193.40:0/3521779343 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b5415bff0 0x7f0b5417c3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.569+0000 7f0b594356c0 1 --2- 10.20.193.40:0/3521779343 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b541146d0 0x7f0b5415bab0 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=5390287783508174496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.569+0000 7f0b594356c0 1 --2- 10.20.193.40:0/3521779343 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b54113dc0 0x7f0b54114190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.569+0000 7f0b594356c0 1 -- 10.20.193.40:0/3521779343 >> 10.20.193.40:0/3521779343 conn(0x7f0b54058a50 msgr2=0x7f0b54058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:53.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.569+0000 7f0b594356c0 1 -- 10.20.193.40:0/3521779343 shutdown_connections 2026-02-13T01:27:53.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.569+0000 7f0b594356c0 1 -- 10.20.193.40:0/3521779343 wait complete. 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.570+0000 7f0b594356c0 1 Processor -- start 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.570+0000 7f0b594356c0 1 -- start start 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b594356c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b54113dc0 0x7f0b540ff060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b594356c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b541146d0 0x7f0b540ff5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b594356c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b5415bff0 0x7f0b54104960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b594356c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54104fb0 con 0x7f0b54113dc0 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b594356c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54105120 con 0x7f0b5415bff0 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b594356c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541052e0 con 0x7f0b541146d0 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b52ffd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b54113dc0 0x7f0b540ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:53.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b52ffd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b54113dc0 0x7f0b540ff060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:40016/0 (socket says 10.20.193.40:40016) 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b52ffd6c0 1 -- 10.20.193.40:0/1409000088 learned_addr learned my addr 10.20.193.40:0/1409000088 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b527fc6c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b541146d0 0x7f0b540ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b537fe6c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b5415bff0 0x7f0b54104960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b52ffd6c0 1 -- 10.20.193.40:0/1409000088 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b541146d0 msgr2=0x7f0b540ff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b52ffd6c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b541146d0 0x7f0b540ff5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b52ffd6c0 1 -- 10.20.193.40:0/1409000088 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b5415bff0 msgr2=0x7f0b54104960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b52ffd6c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b5415bff0 0x7f0b54104960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b52ffd6c0 1 -- 10.20.193.40:0/1409000088 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c009590 con 0x7f0b54113dc0 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b527fc6c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b541146d0 0x7f0b540ff5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.571+0000 7f0b52ffd6c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b54113dc0 0x7f0b540ff060 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b48009490 tx=0x7f0b4800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.572+0000 7f0b33fff6c0 1 -- 10.20.193.40:0/1409000088 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b48004a80 con 0x7f0b54113dc0 2026-02-13T01:27:53.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.572+0000 7f0b33fff6c0 1 -- 10.20.193.40:0/1409000088 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0b48009030 con 0x7f0b54113dc0 2026-02-13T01:27:53.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.572+0000 7f0b33fff6c0 1 -- 10.20.193.40:0/1409000088 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b48007440 con 0x7f0b54113dc0 2026-02-13T01:27:53.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.572+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b541055c0 con 0x7f0b54113dc0 2026-02-13T01:27:53.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.572+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b54157b00 con 0x7f0b54113dc0 2026-02-13T01:27:53.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.572+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b541057e0 con 0x7f0b54113dc0 2026-02-13T01:27:53.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.575+0000 7f0b33fff6c0 1 -- 10.20.193.40:0/1409000088 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0b48004060 con 0x7f0b54113dc0 2026-02-13T01:27:53.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.576+0000 7f0b33fff6c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0b280b5650 0x7f0b280d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:53.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.577+0000 7f0b33fff6c0 1 -- 10.20.193.40:0/1409000088 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f0b480e3bf0 con 0x7f0b54113dc0 2026-02-13T01:27:53.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.577+0000 7f0b33fff6c0 1 -- 10.20.193.40:0/1409000088 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0b480e40e0 con 0x7f0b54113dc0 2026-02-13T01:27:53.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.577+0000 7f0b527fc6c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0b280b5650 0x7f0b280d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:53.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.577+0000 7f0b527fc6c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0b280b5650 0x7f0b280d5b00 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b3c0023e0 tx=0x7f0b3c0071c0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:53.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.700+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0b5405b000 con 0x7f0b54113dc0 2026-02-13T01:27:53.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.701+0000 7f0b33fff6c0 1 -- 10.20.193.40:0/1409000088 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0b480a65d0 con 0x7f0b54113dc0 2026-02-13T01:27:53.702 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:53.703 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:53.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0b280b5650 msgr2=0x7f0b280d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0b280b5650 0x7f0b280d5b00 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b3c0023e0 tx=0x7f0b3c0071c0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b54113dc0 msgr2=0x7f0b540ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b54113dc0 0x7f0b540ff060 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b48009490 tx=0x7f0b4800bca0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 shutdown_connections 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f0b280b5650 0x7f0b280d5b00 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f0b5415bff0 0x7f0b54104960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f0b541146d0 0x7f0b540ff5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 --2- 10.20.193.40:0/1409000088 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0b54113dc0 0x7f0b540ff060 unknown :-1 s=CLOSED pgs=349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 >> 10.20.193.40:0/1409000088 conn(0x7f0b54058a50 msgr2=0x7f0b540f5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:53.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 shutdown_connections 2026-02-13T01:27:53.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:53.702+0000 7f0b594356c0 1 -- 10.20.193.40:0/1409000088 wait complete. 2026-02-13T01:27:54.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:53 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1409000088' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:54.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:53 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1409000088' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:54.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:53 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1409000088' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:55.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:54 trial055 ceph-mon[27509]: pgmap v303: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:55.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:54 trial040 ceph-mon[23046]: pgmap v303: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:55.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:54 trial118 ceph-mon[27812]: pgmap v303: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:56.808 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:56.993 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:27:57.035 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:56 trial040 ceph-mon[23046]: pgmap v304: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:57.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.180+0000 7fc16f1006c0 1 -- 10.20.193.40:0/446286048 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc16810f200 msgr2=0x7fc16810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:57.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.180+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/446286048 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc16810f200 0x7fc16810f5d0 secure :-1 s=READY pgs=350 gs=2 cs=0 l=1 c_cookie=400798957525252961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1580098d0 tx=0x7fc15802ec40 comp rx=0 tx=0).stop 2026-02-13T01:27:57.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.180+0000 7fc16f1006c0 1 -- 10.20.193.40:0/446286048 shutdown_connections 2026-02-13T01:27:57.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.180+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/446286048 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc168115410 0x7fc168175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.180+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/446286048 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc16810fbf0 0x7fc168114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.180+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/446286048 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc16810f200 0x7fc16810f5d0 unknown :-1 s=CLOSED pgs=350 gs=2 cs=0 l=1 c_cookie=400798957525252961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.180+0000 7fc16f1006c0 1 -- 10.20.193.40:0/446286048 >> 10.20.193.40:0/446286048 conn(0x7fc1680ecb00 msgr2=0x7fc16810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:57.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.180+0000 7fc16f1006c0 1 -- 10.20.193.40:0/446286048 shutdown_connections 2026-02-13T01:27:57.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.181+0000 7fc16f1006c0 1 -- 10.20.193.40:0/446286048 wait complete. 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.181+0000 7fc16f1006c0 1 Processor -- start 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.181+0000 7fc16f1006c0 1 -- start start 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16f1006c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc16810f200 0x7fc16811cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16f1006c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc168115410 0x7fc16811d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16f1006c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1681228b0 0x7fc168122d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16f1006c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681232c0 con 0x7fc168115410 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16f1006c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc168123430 con 0x7fc1681228b0 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16f1006c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681235f0 con 0x7fc16810f200 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16ce756c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc16810f200 0x7fc16811cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:57.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16ce756c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc16810f200 0x7fc16811cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:59548/0 (socket says 10.20.193.40:59548) 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16ce756c0 1 -- 10.20.193.40:0/670361622 learned_addr learned my addr 10.20.193.40:0/670361622 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16d6766c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1681228b0 0x7fc168122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc15ffff6c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc168115410 0x7fc16811d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16ce756c0 1 -- 10.20.193.40:0/670361622 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1681228b0 msgr2=0x7fc168122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16ce756c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1681228b0 0x7fc168122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16ce756c0 1 -- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc168115410 msgr2=0x7fc16811d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16ce756c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc168115410 0x7fc16811d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc16ce756c0 1 -- 10.20.193.40:0/670361622 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1580094c0 con 0x7fc16810f200 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.182+0000 7fc15ffff6c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc168115410 0x7fc16811d4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:57.186 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.183+0000 7fc16ce756c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc16810f200 0x7fc16811cfb0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1580023c0 tx=0x7fc15802f750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:57.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.183+0000 7fc15dffb6c0 1 -- 10.20.193.40:0/670361622 <== mon.1 v2:10.20.193.118:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc158005d50 con 0x7fc16810f200 2026-02-13T01:27:57.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.183+0000 7fc15dffb6c0 1 -- 10.20.193.40:0/670361622 <== mon.1 v2:10.20.193.118:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc158031e40 con 0x7fc16810f200 2026-02-13T01:27:57.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.183+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc168163a40 con 0x7fc16810f200 2026-02-13T01:27:57.187 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.183+0000 7fc15dffb6c0 1 -- 10.20.193.40:0/670361622 <== mon.1 v2:10.20.193.118:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc158031970 con 0x7fc16810f200 2026-02-13T01:27:57.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.183+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc168163ec0 con 0x7fc16810f200 2026-02-13T01:27:57.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.183+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1681104d0 con 0x7fc16810f200 2026-02-13T01:27:57.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.186+0000 7fc15dffb6c0 1 -- 10.20.193.40:0/670361622 <== mon.1 v2:10.20.193.118:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fc1580026b0 con 0x7fc16810f200 2026-02-13T01:27:57.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.187+0000 7fc15dffb6c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc1440b56d0 0x7fc1440d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:57.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.187+0000 7fc15ffff6c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc1440b56d0 0x7fc1440d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:57.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.187+0000 7fc15dffb6c0 1 -- 10.20.193.40:0/670361622 <== mon.1 v2:10.20.193.118:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fc158107be0 con 0x7fc16810f200 2026-02-13T01:27:57.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.187+0000 7fc15dffb6c0 1 -- 10.20.193.40:0/670361622 <== mon.1 v2:10.20.193.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc158140640 con 0x7fc16810f200 2026-02-13T01:27:57.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.188+0000 7fc15ffff6c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc1440b56d0 0x7fc1440d5b80 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc150004750 tx=0x7fc150009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:57.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:56 trial055 ceph-mon[27509]: pgmap v304: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:57.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:56 trial118 ceph-mon[27812]: pgmap v304: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:57.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.312+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc16810f5d0 con 0x7fc16810f200 2026-02-13T01:27:57.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.314+0000 7fc15dffb6c0 1 -- 10.20.193.40:0/670361622 <== mon.1 v2:10.20.193.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc1580ca580 con 0x7fc16810f200 2026-02-13T01:27:57.315 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:27:57.315 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:57.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc1440b56d0 msgr2=0x7fc1440d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:57.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc1440b56d0 0x7fc1440d5b80 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc150004750 tx=0x7fc150009310 comp rx=0 tx=0).stop 2026-02-13T01:27:57.316 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc16810f200 msgr2=0x7fc16811cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:57.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc16810f200 0x7fc16811cfb0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1580023c0 tx=0x7fc15802f750 comp rx=0 tx=0).stop 2026-02-13T01:27:57.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 shutdown_connections 2026-02-13T01:27:57.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc1440b56d0 0x7fc1440d5b80 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc1681228b0 0x7fc168122d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc168115410 0x7fc16811d4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 --2- 10.20.193.40:0/670361622 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc16810f200 0x7fc16811cfb0 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 >> 10.20.193.40:0/670361622 conn(0x7fc1680ecb00 msgr2=0x7fc16810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:57.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 shutdown_connections 2026-02-13T01:27:57.318 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:27:57.315+0000 7fc16f1006c0 1 -- 10.20.193.40:0/670361622 wait complete. 2026-02-13T01:27:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:57 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/670361622' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:58.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:57 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:27:58.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:57 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/670361622' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:58.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:57 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:27:58.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:57 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/670361622' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:58.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:57 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:27:59.059 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:58 trial118 ceph-mon[27812]: pgmap v305: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:59.059 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:58 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:59.059 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:58 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:27:59.060 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:58 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:27:59.060 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:58 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:27:59.060 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:58 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:27:59.060 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:58 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:59.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:58 trial055 ceph-mon[27509]: pgmap v305: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:58 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:58 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:27:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:58 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:27:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:58 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:27:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:58 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:27:59.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:58 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:59.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:58 trial040 ceph-mon[23046]: pgmap v305: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:27:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:58 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:58 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:27:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:58 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:27:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:58 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:27:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:58 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:27:59.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:58 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:00.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:27:59 trial055 ceph-mon[27509]: pgmap v306: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-13T01:28:00.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:27:59 trial040 ceph-mon[23046]: pgmap v306: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-13T01:28:00.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:27:59 trial118 ceph-mon[27812]: pgmap v306: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-13T01:28:00.419 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:00.604 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:00.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.802+0000 7fa7d46506c0 1 -- 10.20.193.40:0/350897239 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 msgr2=0x7fa7cc179ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:00.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.802+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/350897239 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 0x7fa7cc179ea0 secure :-1 s=READY pgs=351 gs=2 cs=0 l=1 c_cookie=4770232072726335443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7c8006fd0 tx=0x7fa7c802fd30 comp rx=0 tx=0).stop 2026-02-13T01:28:00.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.802+0000 7fa7d46506c0 1 -- 10.20.193.40:0/350897239 shutdown_connections 2026-02-13T01:28:00.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.802+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/350897239 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 0x7fa7cc179ea0 unknown :-1 s=CLOSED pgs=351 gs=2 cs=0 l=1 c_cookie=4770232072726335443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.802+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/350897239 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa7cc060ce0 0x7fa7cc061110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.802+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/350897239 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa7cc0622d0 0x7fa7cc0607a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.802+0000 7fa7d46506c0 1 -- 10.20.193.40:0/350897239 >> 10.20.193.40:0/350897239 conn(0x7fa7cc0ea880 msgr2=0x7fa7cc10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:00.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.802+0000 7fa7d46506c0 1 -- 10.20.193.40:0/350897239 shutdown_connections 2026-02-13T01:28:00.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.802+0000 7fa7d46506c0 1 -- 10.20.193.40:0/350897239 wait complete. 2026-02-13T01:28:00.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.803+0000 7fa7d46506c0 1 Processor -- start 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.803+0000 7fa7d46506c0 1 -- start start 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d46506c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa7cc060ce0 0x7fa7cc161000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d46506c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa7cc0622d0 0x7fa7cc161540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d46506c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 0x7fa7cc166900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d46506c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc166f50 con 0x7fa7cc159ac0 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d46506c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc1670c0 con 0x7fa7cc060ce0 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d46506c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc167280 con 0x7fa7cc0622d0 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d2bc26c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 0x7fa7cc166900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d2bc26c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 0x7fa7cc166900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:43876/0 (socket says 10.20.193.40:43876) 2026-02-13T01:28:00.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d2bc26c0 1 -- 10.20.193.40:0/3813693364 learned_addr learned my addr 10.20.193.40:0/3813693364 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d23c16c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa7cc060ce0 0x7fa7cc161000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d1bc06c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa7cc0622d0 0x7fa7cc161540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d2bc26c0 1 -- 10.20.193.40:0/3813693364 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa7cc0622d0 msgr2=0x7fa7cc161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d2bc26c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa7cc0622d0 0x7fa7cc161540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d2bc26c0 1 -- 10.20.193.40:0/3813693364 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa7cc060ce0 msgr2=0x7fa7cc161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d2bc26c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa7cc060ce0 0x7fa7cc161000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d2bc26c0 1 -- 10.20.193.40:0/3813693364 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c800a5b0 con 0x7fa7cc159ac0 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d2bc26c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 0x7fa7cc166900 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7c800a900 tx=0x7fa7c80307c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7b37fe6c0 1 -- 10.20.193.40:0/3813693364 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7c8003a30 con 0x7fa7cc159ac0 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7b37fe6c0 1 -- 10.20.193.40:0/3813693364 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa7c8006e30 con 0x7fa7cc159ac0 2026-02-13T01:28:00.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7b37fe6c0 1 -- 10.20.193.40:0/3813693364 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7c8036460 con 0x7fa7cc159ac0 2026-02-13T01:28:00.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.804+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7cc167500 con 0x7fa7cc159ac0 2026-02-13T01:28:00.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.805+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7cc167780 con 0x7fa7cc159ac0 2026-02-13T01:28:00.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.805+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7cc061cb0 con 0x7fa7cc159ac0 2026-02-13T01:28:00.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.807+0000 7fa7b37fe6c0 1 -- 10.20.193.40:0/3813693364 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa7c80085f0 con 0x7fa7cc159ac0 2026-02-13T01:28:00.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.809+0000 7fa7b37fe6c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa7a80b56d0 0x7fa7a80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:00.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.809+0000 7fa7b37fe6c0 1 -- 10.20.193.40:0/3813693364 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fa7c8108f80 con 0x7fa7cc159ac0 2026-02-13T01:28:00.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.809+0000 7fa7d23c16c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa7a80b56d0 0x7fa7a80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:00.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.809+0000 7fa7b37fe6c0 1 -- 10.20.193.40:0/3813693364 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa7c8109400 con 0x7fa7cc159ac0 2026-02-13T01:28:00.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.809+0000 7fa7d23c16c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa7a80b56d0 0x7fa7a80d5b80 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7bc005b40 tx=0x7fa7bc009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:00.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.933+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa7cc061110 con 0x7fa7cc159ac0 2026-02-13T01:28:00.935 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.933+0000 7fa7b37fe6c0 1 -- 10.20.193.40:0/3813693364 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa7c80cb920 con 0x7fa7cc159ac0 2026-02-13T01:28:00.935 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:00.935 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:00.936 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa7a80b56d0 msgr2=0x7fa7a80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa7a80b56d0 0x7fa7a80d5b80 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7bc005b40 tx=0x7fa7bc009310 comp rx=0 tx=0).stop 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 msgr2=0x7fa7cc166900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 0x7fa7cc166900 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7c800a900 tx=0x7fa7c80307c0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 shutdown_connections 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa7a80b56d0 0x7fa7a80d5b80 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa7cc159ac0 0x7fa7cc166900 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa7cc0622d0 0x7fa7cc161540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 --2- 10.20.193.40:0/3813693364 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa7cc060ce0 0x7fa7cc161000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 >> 10.20.193.40:0/3813693364 conn(0x7fa7cc0ea880 msgr2=0x7fa7cc10ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:00.937 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 shutdown_connections 2026-02-13T01:28:00.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:00.935+0000 7fa7d46506c0 1 -- 10.20.193.40:0/3813693364 wait complete. 2026-02-13T01:28:00.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:00 trial040 ceph-mon[23046]: pgmap v307: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:01.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:00 trial055 ceph-mon[27509]: pgmap v307: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:01.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:00 trial118 ceph-mon[27812]: pgmap v307: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:02.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:01 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3813693364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:02.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:01 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3813693364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:02.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:01 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3813693364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:03.155 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:02 trial118 ceph-mon[27812]: pgmap v308: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:03.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:02 trial055 ceph-mon[27509]: pgmap v308: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:03.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:02 trial040 ceph-mon[23046]: pgmap v308: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:04.042 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:04.229 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:04.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.432+0000 7fc2a68976c0 1 -- 10.20.193.40:0/3208012705 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 msgr2=0x7fc2a0175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.432+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/3208012705 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 0x7fc2a0175c10 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=3929879630053466950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc29c00aa70 tx=0x7fc29c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.432+0000 7fc2a68976c0 1 -- 10.20.193.40:0/3208012705 shutdown_connections 2026-02-13T01:28:04.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.432+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/3208012705 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 0x7fc2a0175c10 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=3929879630053466950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.432+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/3208012705 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2a010fa50 0x7fc2a0114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.432+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/3208012705 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc2a010f060 0x7fc2a010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.432+0000 7fc2a68976c0 1 -- 10.20.193.40:0/3208012705 >> 10.20.193.40:0/3208012705 conn(0x7fc2a00ec980 msgr2=0x7fc2a010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:04.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.433+0000 7fc2a68976c0 1 -- 10.20.193.40:0/3208012705 shutdown_connections 2026-02-13T01:28:04.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.433+0000 7fc2a68976c0 1 -- 10.20.193.40:0/3208012705 wait complete. 2026-02-13T01:28:04.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a68976c0 1 Processor -- start 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a68976c0 1 -- start start 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a68976c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc2a010f060 0x7fc2a011cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a68976c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 0x7fc2a011d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a68976c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2a0122690 0x7fc2a0122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a68976c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01230a0 con 0x7fc2a0115270 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a68976c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0123210 con 0x7fc2a010f060 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a68976c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01233d0 con 0x7fc2a0122690 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a50946c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 0x7fc2a011d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a58956c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc2a010f060 0x7fc2a011cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a50946c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 0x7fc2a011d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:43900/0 (socket says 10.20.193.40:43900) 2026-02-13T01:28:04.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a50946c0 1 -- 10.20.193.40:0/597103163 learned_addr learned my addr 10.20.193.40:0/597103163 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.434+0000 7fc2a60966c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2a0122690 0x7fc2a0122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc2a50946c0 1 -- 10.20.193.40:0/597103163 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2a0122690 msgr2=0x7fc2a0122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc2a50946c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2a0122690 0x7fc2a0122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc2a50946c0 1 -- 10.20.193.40:0/597103163 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc2a010f060 msgr2=0x7fc2a011cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc2a50946c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc2a010f060 0x7fc2a011cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc2a50946c0 1 -- 10.20.193.40:0/597103163 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c00a660 con 0x7fc2a0115270 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc2a50946c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 0x7fc2a011d2d0 secure :-1 s=READY pgs=354 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc29400b750 tx=0x7fc29400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc28effd6c0 1 -- 10.20.193.40:0/597103163 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc294004a80 con 0x7fc2a0115270 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a0163880 con 0x7fc2a0115270 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a0163d10 con 0x7fc2a0115270 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc28effd6c0 1 -- 10.20.193.40:0/597103163 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc294009030 con 0x7fc2a0115270 2026-02-13T01:28:04.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.435+0000 7fc28effd6c0 1 -- 10.20.193.40:0/597103163 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc294005810 con 0x7fc2a0115270 2026-02-13T01:28:04.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.436+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a0110330 con 0x7fc2a0115270 2026-02-13T01:28:04.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.438+0000 7fc28effd6c0 1 -- 10.20.193.40:0/597103163 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fc29400c6e0 con 0x7fc2a0115270 2026-02-13T01:28:04.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.439+0000 7fc28effd6c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc27c0b56c0 0x7fc27c0d5b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:04.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.439+0000 7fc28effd6c0 1 -- 10.20.193.40:0/597103163 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fc2940e3b40 con 0x7fc2a0115270 2026-02-13T01:28:04.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.440+0000 7fc2a58956c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc27c0b56c0 0x7fc27c0d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:04.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.440+0000 7fc28effd6c0 1 -- 10.20.193.40:0/597103163 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc29411c5e0 con 0x7fc2a0115270 2026-02-13T01:28:04.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.440+0000 7fc2a58956c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc27c0b56c0 0x7fc27c0d5b70 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc290004750 tx=0x7fc290009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:04.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.565+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc2a010f430 con 0x7fc2a0115270 2026-02-13T01:28:04.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.565+0000 7fc28effd6c0 1 -- 10.20.193.40:0/597103163 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc2940a64e0 con 0x7fc2a0115270 2026-02-13T01:28:04.567 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:04.567 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:04.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc27c0b56c0 msgr2=0x7fc27c0d5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc27c0b56c0 0x7fc27c0d5b70 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc290004750 tx=0x7fc290009260 comp rx=0 tx=0).stop 2026-02-13T01:28:04.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 msgr2=0x7fc2a011d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 0x7fc2a011d2d0 secure :-1 s=READY pgs=354 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc29400b750 tx=0x7fc29400bc20 comp rx=0 tx=0).stop 2026-02-13T01:28:04.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 shutdown_connections 2026-02-13T01:28:04.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fc27c0b56c0 0x7fc27c0d5b70 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fc2a0122690 0x7fc2a0122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc2a0115270 0x7fc2a011d2d0 unknown :-1 s=CLOSED pgs=354 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 --2- 10.20.193.40:0/597103163 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fc2a010f060 0x7fc2a011cd90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.566+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 >> 10.20.193.40:0/597103163 conn(0x7fc2a00ec980 msgr2=0x7fc2a010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:04.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.567+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 shutdown_connections 2026-02-13T01:28:04.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:04.567+0000 7fc2a68976c0 1 -- 10.20.193.40:0/597103163 wait complete. 2026-02-13T01:28:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:04 trial040 ceph-mon[23046]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:28:04.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:04 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/597103163' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:05.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:04 trial055 ceph-mon[27509]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:28:05.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:04 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/597103163' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:05.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:04 trial118 ceph-mon[27812]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:28:05.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:04 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/597103163' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:07.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:06 trial055 ceph-mon[27509]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:28:07.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:06 trial040 ceph-mon[23046]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:28:07.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:06 trial118 ceph-mon[27812]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:28:07.705 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:07.890 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:08.085 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.084+0000 7feb42dc66c0 1 -- 10.20.193.40:0/3144691487 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 msgr2=0x7feb3c175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.084+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/3144691487 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 0x7feb3c175c10 secure :-1 s=READY pgs=355 gs=2 cs=0 l=1 c_cookie=7833260886940659708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3800aa70 tx=0x7feb3802fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.084+0000 7feb42dc66c0 1 -- 10.20.193.40:0/3144691487 shutdown_connections 2026-02-13T01:28:08.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.084+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/3144691487 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 0x7feb3c175c10 unknown :-1 s=CLOSED pgs=355 gs=2 cs=0 l=1 c_cookie=7833260886940659708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.084+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/3144691487 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7feb3c10fa50 0x7feb3c114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.084+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/3144691487 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7feb3c10f060 0x7feb3c10f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.084+0000 7feb42dc66c0 1 -- 10.20.193.40:0/3144691487 >> 10.20.193.40:0/3144691487 conn(0x7feb3c0ec980 msgr2=0x7feb3c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:08.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.084+0000 7feb42dc66c0 1 -- 10.20.193.40:0/3144691487 shutdown_connections 2026-02-13T01:28:08.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.084+0000 7feb42dc66c0 1 -- 10.20.193.40:0/3144691487 wait complete. 2026-02-13T01:28:08.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.085+0000 7feb42dc66c0 1 Processor -- start 2026-02-13T01:28:08.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.085+0000 7feb42dc66c0 1 -- start start 2026-02-13T01:28:08.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.085+0000 7feb42dc66c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7feb3c10f060 0x7feb3c10cc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:08.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.085+0000 7feb42dc66c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 0x7feb3c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:08.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.085+0000 7feb42dc66c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7feb3c109e80 0x7feb3c10a320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.085+0000 7feb42dc66c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c10a860 con 0x7feb3c115270 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.085+0000 7feb42dc66c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c10a9d0 con 0x7feb3c10f060 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.085+0000 7feb42dc66c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c10ab90 con 0x7feb3c109e80 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb415c36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 0x7feb3c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb415c36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 0x7feb3c175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:43908/0 (socket says 10.20.193.40:43908) 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb415c36c0 1 -- 10.20.193.40:0/4138103493 learned_addr learned my addr 10.20.193.40:0/4138103493 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb425c56c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7feb3c109e80 0x7feb3c10a320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb41dc46c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7feb3c10f060 0x7feb3c10cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb415c36c0 1 -- 10.20.193.40:0/4138103493 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7feb3c109e80 msgr2=0x7feb3c10a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb415c36c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7feb3c109e80 0x7feb3c10a320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb415c36c0 1 -- 10.20.193.40:0/4138103493 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7feb3c10f060 msgr2=0x7feb3c10cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb415c36c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7feb3c10f060 0x7feb3c10cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb415c36c0 1 -- 10.20.193.40:0/4138103493 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3800a660 con 0x7feb3c115270 2026-02-13T01:28:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb415c36c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 0x7feb3c175b10 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb30005dc0 tx=0x7feb3000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb2affd6c0 1 -- 10.20.193.40:0/4138103493 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb30004250 con 0x7feb3c115270 2026-02-13T01:28:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb2affd6c0 1 -- 10.20.193.40:0/4138103493 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7feb30009070 con 0x7feb3c115270 2026-02-13T01:28:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb2affd6c0 1 -- 10.20.193.40:0/4138103493 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb300071c0 con 0x7feb3c115270 2026-02-13T01:28:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3c0efd80 con 0x7feb3c115270 2026-02-13T01:28:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.086+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3c0f0210 con 0x7feb3c115270 2026-02-13T01:28:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.087+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3c110330 con 0x7feb3c115270 2026-02-13T01:28:08.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.089+0000 7feb2affd6c0 1 -- 10.20.193.40:0/4138103493 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7feb300043b0 con 0x7feb3c115270 2026-02-13T01:28:08.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.090+0000 7feb2affd6c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7feb180b56c0 0x7feb180d5b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:08.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.090+0000 7feb2affd6c0 1 -- 10.20.193.40:0/4138103493 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7feb300e3a10 con 0x7feb3c115270 2026-02-13T01:28:08.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.091+0000 7feb41dc46c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7feb180b56c0 0x7feb180d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:08.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.091+0000 7feb2affd6c0 1 -- 10.20.193.40:0/4138103493 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feb3011c5e0 con 0x7feb3c115270 2026-02-13T01:28:08.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.091+0000 7feb41dc46c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7feb180b56c0 0x7feb180d5b70 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb2c005dc0 tx=0x7feb2c005d10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:08.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.214+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feb3c10fa50 con 0x7feb3c115270 2026-02-13T01:28:08.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.215+0000 7feb2affd6c0 1 -- 10.20.193.40:0/4138103493 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7feb300a63b0 con 0x7feb3c115270 2026-02-13T01:28:08.216 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:08.216 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:08.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7feb180b56c0 msgr2=0x7feb180d5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7feb180b56c0 0x7feb180d5b70 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb2c005dc0 tx=0x7feb2c005d10 comp rx=0 tx=0).stop 2026-02-13T01:28:08.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 msgr2=0x7feb3c175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 0x7feb3c175b10 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb30005dc0 tx=0x7feb3000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 shutdown_connections 2026-02-13T01:28:08.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7feb180b56c0 0x7feb180d5b70 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7feb3c109e80 0x7feb3c10a320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feb3c115270 0x7feb3c175b10 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 --2- 10.20.193.40:0/4138103493 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7feb3c10f060 0x7feb3c10cc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 >> 10.20.193.40:0/4138103493 conn(0x7feb3c0ec980 msgr2=0x7feb3c10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:08.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 shutdown_connections 2026-02-13T01:28:08.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:08.216+0000 7feb42dc66c0 1 -- 10.20.193.40:0/4138103493 wait complete. 2026-02-13T01:28:09.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:08 trial055 ceph-mon[27509]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:09.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:08 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4138103493' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:09.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:08 trial040 ceph-mon[23046]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:09.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:08 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4138103493' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:09.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:08 trial118 ceph-mon[27812]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:09.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:08 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4138103493' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:11.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:10 trial055 ceph-mon[27509]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:11.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:10 trial040 ceph-mon[23046]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:11.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:10 trial118 ceph-mon[27812]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:11.321 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:11.505 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:11.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.702+0000 7f501cb326c0 1 -- 10.20.193.40:0/1484047018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5018115270 msgr2=0x7f5018175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.702+0000 7f501cb326c0 1 --2- 10.20.193.40:0/1484047018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5018115270 0x7f5018175c10 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=3745818953218394891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f500c00a9b0 tx=0x7f500c02fd20 comp rx=0 tx=0).stop 2026-02-13T01:28:11.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.702+0000 7f501cb326c0 1 -- 10.20.193.40:0/1484047018 shutdown_connections 2026-02-13T01:28:11.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.702+0000 7f501cb326c0 1 --2- 10.20.193.40:0/1484047018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5018115270 0x7f5018175c10 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=3745818953218394891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.702+0000 7f501cb326c0 1 --2- 10.20.193.40:0/1484047018 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f501810fa50 0x7f5018114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.702+0000 7f501cb326c0 1 --2- 10.20.193.40:0/1484047018 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f501810f060 0x7f501810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.702+0000 7f501cb326c0 1 -- 10.20.193.40:0/1484047018 >> 10.20.193.40:0/1484047018 conn(0x7f50180ec980 msgr2=0x7f501810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:11.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.702+0000 7f501cb326c0 1 -- 10.20.193.40:0/1484047018 shutdown_connections 2026-02-13T01:28:11.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.702+0000 7f501cb326c0 1 -- 10.20.193.40:0/1484047018 wait complete. 2026-02-13T01:28:11.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f501cb326c0 1 Processor -- start 2026-02-13T01:28:11.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f501cb326c0 1 -- start start 2026-02-13T01:28:11.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f501cb326c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f501810f060 0x7f501811cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:11.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f501cb326c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5018115270 0x7f501811d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:11.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f501cb326c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5018122690 0x7f5018122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:11.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f501cb326c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f50181230a0 con 0x7f501810f060 2026-02-13T01:28:11.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f501cb326c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5018123210 con 0x7f5018122690 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f501cb326c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f50181233d0 con 0x7f5018115270 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f50177fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f501810f060 0x7f501811cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f5017fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5018122690 0x7f5018122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f5017fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5018122690 0x7f5018122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:38062/0 (socket says 10.20.193.40:38062) 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f5017fff6c0 1 -- 10.20.193.40:0/515948215 learned_addr learned my addr 10.20.193.40:0/515948215 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.703+0000 7f5016ffd6c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5018115270 0x7f501811d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f50177fe6c0 1 -- 10.20.193.40:0/515948215 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5018115270 msgr2=0x7f501811d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f50177fe6c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5018115270 0x7f501811d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f50177fe6c0 1 -- 10.20.193.40:0/515948215 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5018122690 msgr2=0x7f5018122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f50177fe6c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5018122690 0x7f5018122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f50177fe6c0 1 -- 10.20.193.40:0/515948215 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5004009590 con 0x7f501810f060 2026-02-13T01:28:11.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f50177fe6c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f501810f060 0x7f501811cd90 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5004004750 tx=0x7f500400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:11.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f5014ff96c0 1 -- 10.20.193.40:0/515948215 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5004004250 con 0x7f501810f060 2026-02-13T01:28:11.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f5014ff96c0 1 -- 10.20.193.40:0/515948215 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5004002df0 con 0x7f501810f060 2026-02-13T01:28:11.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f5014ff96c0 1 -- 10.20.193.40:0/515948215 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5004007440 con 0x7f501810f060 2026-02-13T01:28:11.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500c00a5b0 con 0x7f501810f060 2026-02-13T01:28:11.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.704+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5018163b80 con 0x7f501810f060 2026-02-13T01:28:11.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.705+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5018110330 con 0x7f501810f060 2026-02-13T01:28:11.708 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.707+0000 7f5014ff96c0 1 -- 10.20.193.40:0/515948215 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f500400c6a0 con 0x7f501810f060 2026-02-13T01:28:11.709 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.708+0000 7f5014ff96c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4fec0b56d0 0x7f4fec0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:11.710 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.708+0000 7f5014ff96c0 1 -- 10.20.193.40:0/515948215 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f50040e3d90 con 0x7f501810f060 2026-02-13T01:28:11.710 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.708+0000 7f5014ff96c0 1 -- 10.20.193.40:0/515948215 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f50040e4280 con 0x7f501810f060 2026-02-13T01:28:11.710 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.708+0000 7f5016ffd6c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4fec0b56d0 0x7f4fec0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:11.710 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.709+0000 7f5016ffd6c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4fec0b56d0 0x7f4fec0d5b80 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5018123720 tx=0x7f5008009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:11.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.835+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f501811df10 con 0x7f501810f060 2026-02-13T01:28:11.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.835+0000 7f5014ff96c0 1 -- 10.20.193.40:0/515948215 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f50040a6770 con 0x7f501810f060 2026-02-13T01:28:11.837 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:11.837 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:11.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.836+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4fec0b56d0 msgr2=0x7f4fec0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.836+0000 7f501cb326c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4fec0b56d0 0x7f4fec0d5b80 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5018123720 tx=0x7f5008009260 comp rx=0 tx=0).stop 2026-02-13T01:28:11.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.836+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f501810f060 msgr2=0x7f501811cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.836+0000 7f501cb326c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f501810f060 0x7f501811cd90 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5004004750 tx=0x7f500400bed0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.837+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 shutdown_connections 2026-02-13T01:28:11.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.837+0000 7f501cb326c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4fec0b56d0 0x7f4fec0d5b80 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.837+0000 7f501cb326c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5018122690 0x7f5018122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.837+0000 7f501cb326c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5018115270 0x7f501811d2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.837+0000 7f501cb326c0 1 --2- 10.20.193.40:0/515948215 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f501810f060 0x7f501811cd90 unknown :-1 s=CLOSED pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.837+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 >> 10.20.193.40:0/515948215 conn(0x7f50180ec980 msgr2=0x7f501810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:11.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.837+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 shutdown_connections 2026-02-13T01:28:11.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:11.837+0000 7f501cb326c0 1 -- 10.20.193.40:0/515948215 wait complete. 2026-02-13T01:28:13.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:12 trial055 ceph-mon[27509]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:13.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:12 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/515948215' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:13.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:12 trial040 ceph-mon[23046]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:13.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:12 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/515948215' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:13.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:12 trial118 ceph-mon[27812]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:13.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:12 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/515948215' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:14.974 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:15.160 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:15.203 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:14 trial040 ceph-mon[23046]: pgmap v314: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:15.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:14 trial055 ceph-mon[27509]: pgmap v314: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:15.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:14 trial118 ceph-mon[27812]: pgmap v314: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:15.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.359+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/2750267441 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f9fe010fa50 msgr2=0x7f9fe0114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:15.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.359+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/2750267441 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f9fe010fa50 0x7f9fe0114a90 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=13522769357585635943 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fd4009970 tx=0x7f9fd402ed10 comp rx=0 tx=0).stop 2026-02-13T01:28:15.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.359+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/2750267441 shutdown_connections 2026-02-13T01:28:15.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.359+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/2750267441 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9fe0115270 0x7f9fe0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.359+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/2750267441 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f9fe010fa50 0x7f9fe0114a90 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=13522769357585635943 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.359+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/2750267441 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9fe010f060 0x7f9fe010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.359+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/2750267441 >> 10.20.193.40:0/2750267441 conn(0x7f9fe00ec980 msgr2=0x7f9fe010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:15.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.359+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/2750267441 shutdown_connections 2026-02-13T01:28:15.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.359+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/2750267441 wait complete. 2026-02-13T01:28:15.363 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.360+0000 7f9fe60f76c0 1 Processor -- start 2026-02-13T01:28:15.363 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.360+0000 7f9fe60f76c0 1 -- start start 2026-02-13T01:28:15.363 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.360+0000 7f9fe60f76c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9fe010f060 0x7f9fe00f4790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:15.363 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.360+0000 7f9fe60f76c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f9fe0115270 0x7f9fe0175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:15.363 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.360+0000 7f9fe60f76c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9fe00f4dc0 0x7f9fe00fa090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.360+0000 7f9fe60f76c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00f54b0 con 0x7f9fe010f060 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.360+0000 7f9fe60f76c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00fa5d0 con 0x7f9fe0115270 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.360+0000 7f9fe60f76c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00fa790 con 0x7f9fe00f4dc0 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.360+0000 7f9fe50f56c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9fe010f060 0x7f9fe00f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe50f56c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9fe010f060 0x7f9fe00f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:52990/0 (socket says 10.20.193.40:52990) 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe50f56c0 1 -- 10.20.193.40:0/1315330673 learned_addr learned my addr 10.20.193.40:0/1315330673 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe48f46c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f9fe0115270 0x7f9fe0175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe58f66c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9fe00f4dc0 0x7f9fe00fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe50f56c0 1 -- 10.20.193.40:0/1315330673 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9fe00f4dc0 msgr2=0x7f9fe00fa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe50f56c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9fe00f4dc0 0x7f9fe00fa090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe50f56c0 1 -- 10.20.193.40:0/1315330673 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f9fe0115270 msgr2=0x7f9fe0175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:15.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe50f56c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f9fe0115270 0x7f9fe0175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe50f56c0 1 -- 10.20.193.40:0/1315330673 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd00094c0 con 0x7f9fe010f060 2026-02-13T01:28:15.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe50f56c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9fe010f060 0x7f9fe00f4790 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fd000ba30 tx=0x7f9fd000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:15.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fce7fc6c0 1 -- 10.20.193.40:0/1315330673 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fd00044a0 con 0x7f9fe010f060 2026-02-13T01:28:15.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fce7fc6c0 1 -- 10.20.193.40:0/1315330673 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9fd0009030 con 0x7f9fe010f060 2026-02-13T01:28:15.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd4009590 con 0x7f9fe010f060 2026-02-13T01:28:15.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fce7fc6c0 1 -- 10.20.193.40:0/1315330673 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fd00071c0 con 0x7f9fe010f060 2026-02-13T01:28:15.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.361+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe00fae10 con 0x7f9fe010f060 2026-02-13T01:28:15.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.362+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe0110330 con 0x7f9fe010f060 2026-02-13T01:28:15.366 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.364+0000 7f9fce7fc6c0 1 -- 10.20.193.40:0/1315330673 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f9fd000c5d0 con 0x7f9fe010f060 2026-02-13T01:28:15.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.366+0000 7f9fce7fc6c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f9fbc0b56d0 0x7f9fbc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:15.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.366+0000 7f9fce7fc6c0 1 -- 10.20.193.40:0/1315330673 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f9fd00e3b90 con 0x7f9fe010f060 2026-02-13T01:28:15.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.366+0000 7f9fe48f46c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f9fbc0b56d0 0x7f9fbc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:15.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.366+0000 7f9fce7fc6c0 1 -- 10.20.193.40:0/1315330673 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9fd011c600 con 0x7f9fe010f060 2026-02-13T01:28:15.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.366+0000 7f9fe48f46c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f9fbc0b56d0 0x7f9fbc0d5b80 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fe00fb120 tx=0x7f9fd40023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:15.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.490+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9fe010f430 con 0x7f9fe010f060 2026-02-13T01:28:15.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.490+0000 7f9fce7fc6c0 1 -- 10.20.193.40:0/1315330673 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9fd00a65c0 con 0x7f9fe010f060 2026-02-13T01:28:15.492 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:15.492 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:15.493 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f9fbc0b56d0 msgr2=0x7f9fbc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:15.493 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f9fbc0b56d0 0x7f9fbc0d5b80 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fe00fb120 tx=0x7f9fd40023a0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.493 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9fe010f060 msgr2=0x7f9fe00f4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:15.493 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9fe010f060 0x7f9fe00f4790 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fd000ba30 tx=0x7f9fd000bf00 comp rx=0 tx=0).stop 2026-02-13T01:28:15.493 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 shutdown_connections 2026-02-13T01:28:15.493 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f9fbc0b56d0 0x7f9fbc0d5b80 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f9fe00f4dc0 0x7f9fe00fa090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f9fe0115270 0x7f9fe0175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 --2- 10.20.193.40:0/1315330673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9fe010f060 0x7f9fe00f4790 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 >> 10.20.193.40:0/1315330673 conn(0x7f9fe00ec980 msgr2=0x7f9fe010d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:15.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 shutdown_connections 2026-02-13T01:28:15.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:15.492+0000 7f9fe60f76c0 1 -- 10.20.193.40:0/1315330673 wait complete. 2026-02-13T01:28:16.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:15 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1315330673' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:16.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:15 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1315330673' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:16.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:15 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1315330673' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:17.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:16 trial055 ceph-mon[27509]: pgmap v315: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:17.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:16 trial040 ceph-mon[23046]: pgmap v315: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:17.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:16 trial118 ceph-mon[27812]: pgmap v315: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:18.600 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:18.786 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:18.916 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:18 trial040 ceph-mon[23046]: pgmap v316: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:18.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.983+0000 7f544f5776c0 1 -- 10.20.193.40:0/4078284685 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f545010fa50 msgr2=0x7f5450114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:18.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.983+0000 7f544f5776c0 1 --2- 10.20.193.40:0/4078284685 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f545010fa50 0x7f5450114a90 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=4839383988222677009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54380099a0 tx=0x7f543802ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:18.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.983+0000 7f544f5776c0 1 -- 10.20.193.40:0/4078284685 shutdown_connections 2026-02-13T01:28:18.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.983+0000 7f544f5776c0 1 --2- 10.20.193.40:0/4078284685 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f5450115270 0x7f5450175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.983+0000 7f544f5776c0 1 --2- 10.20.193.40:0/4078284685 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f545010fa50 0x7f5450114a90 unknown :-1 s=CLOSED pgs=360 gs=1 cs=0 l=1 c_cookie=4839383988222677009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.983+0000 7f544f5776c0 1 --2- 10.20.193.40:0/4078284685 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f545010f060 0x7f545010f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.983+0000 7f544f5776c0 1 -- 10.20.193.40:0/4078284685 >> 10.20.193.40:0/4078284685 conn(0x7f54500ec980 msgr2=0x7f545010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:18.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.983+0000 7f544f5776c0 1 -- 10.20.193.40:0/4078284685 shutdown_connections 2026-02-13T01:28:18.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.983+0000 7f544f5776c0 1 -- 10.20.193.40:0/4078284685 wait complete. 2026-02-13T01:28:18.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544f5776c0 1 Processor -- start 2026-02-13T01:28:18.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544f5776c0 1 -- start start 2026-02-13T01:28:18.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544f5776c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f545010f060 0x7f54500f4860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544f5776c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5450115270 0x7f5450175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544f5776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54500f4e90 0x7f54500fa160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544f5776c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f54500f5580 con 0x7f54500f4e90 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544f5776c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f54500fa6a0 con 0x7f5450115270 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544f5776c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f54500fa860 con 0x7f545010f060 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544ed766c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54500f4e90 0x7f54500fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544e5756c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f545010f060 0x7f54500f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544ed766c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54500f4e90 0x7f54500fa160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:53006/0 (socket says 10.20.193.40:53006) 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544dd746c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5450115270 0x7f5450175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:18.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.984+0000 7f544ed766c0 1 -- 10.20.193.40:0/837676057 learned_addr learned my addr 10.20.193.40:0/837676057 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f544ed766c0 1 -- 10.20.193.40:0/837676057 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f545010f060 msgr2=0x7f54500f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f544ed766c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f545010f060 0x7f54500f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f544ed766c0 1 -- 10.20.193.40:0/837676057 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5450115270 msgr2=0x7f5450175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f544ed766c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5450115270 0x7f5450175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f544ed766c0 1 -- 10.20.193.40:0/837676057 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5438009590 con 0x7f54500f4e90 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f544ed766c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54500f4e90 0x7f54500fa160 secure :-1 s=READY pgs=361 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5440006ea0 tx=0x7f544000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f54377fe6c0 1 -- 10.20.193.40:0/837676057 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5440003a30 con 0x7f54500f4e90 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f54377fe6c0 1 -- 10.20.193.40:0/837676057 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5440005560 con 0x7f54500f4e90 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f54377fe6c0 1 -- 10.20.193.40:0/837676057 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54400082a0 con 0x7f54500f4e90 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54500fab40 con 0x7f54500f4e90 2026-02-13T01:28:18.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.985+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54500fafd0 con 0x7f54500f4e90 2026-02-13T01:28:18.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.986+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5450110330 con 0x7f54500f4e90 2026-02-13T01:28:18.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.988+0000 7f54377fe6c0 1 -- 10.20.193.40:0/837676057 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f544000d4d0 con 0x7f54500f4e90 2026-02-13T01:28:18.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.989+0000 7f54377fe6c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f54280b56d0 0x7f54280d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:18.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.989+0000 7f54377fe6c0 1 -- 10.20.193.40:0/837676057 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f54400e4860 con 0x7f54500f4e90 2026-02-13T01:28:18.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.989+0000 7f544e5756c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f54280b56d0 0x7f54280d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:18.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.989+0000 7f54377fe6c0 1 -- 10.20.193.40:0/837676057 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f54400e4ce0 con 0x7f54500f4e90 2026-02-13T01:28:18.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:18.990+0000 7f544e5756c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f54280b56d0 0x7f54280d5b80 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5444004750 tx=0x7f5444009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:19.115 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.113+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f545010f430 con 0x7f54500f4e90 2026-02-13T01:28:19.115 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.113+0000 7f54377fe6c0 1 -- 10.20.193.40:0/837676057 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f54400a7200 con 0x7f54500f4e90 2026-02-13T01:28:19.115 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:19.115 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:19.116 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.114+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f54280b56d0 msgr2=0x7f54280d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:19.116 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.114+0000 7f544f5776c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f54280b56d0 0x7f54280d5b80 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5444004750 tx=0x7f5444009390 comp rx=0 tx=0).stop 2026-02-13T01:28:19.116 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.114+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54500f4e90 msgr2=0x7f54500fa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:19.117 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.114+0000 7f544f5776c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54500f4e90 0x7f54500fa160 secure :-1 s=READY pgs=361 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5440006ea0 tx=0x7f544000cca0 comp rx=0 tx=0).stop 2026-02-13T01:28:19.117 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.115+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 shutdown_connections 2026-02-13T01:28:19.117 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.115+0000 7f544f5776c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f54280b56d0 0x7f54280d5b80 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:19.117 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.115+0000 7f544f5776c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54500f4e90 0x7f54500fa160 unknown :-1 s=CLOSED pgs=361 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:19.117 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.115+0000 7f544f5776c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f5450115270 0x7f5450175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:19.117 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.115+0000 7f544f5776c0 1 --2- 10.20.193.40:0/837676057 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f545010f060 0x7f54500f4860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:19.117 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.115+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 >> 10.20.193.40:0/837676057 conn(0x7f54500ec980 msgr2=0x7f545010d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:19.117 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.115+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 shutdown_connections 2026-02-13T01:28:19.117 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:19.115+0000 7f544f5776c0 1 -- 10.20.193.40:0/837676057 wait complete. 2026-02-13T01:28:19.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:18 trial055 ceph-mon[27509]: pgmap v316: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:19.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:18 trial118 ceph-mon[27812]: pgmap v316: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:20.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:19 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/837676057' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:20.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:19 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/837676057' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:20.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:19 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/837676057' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:21.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:20 trial055 ceph-mon[27509]: pgmap v317: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:21.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:20 trial040 ceph-mon[23046]: pgmap v317: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:21.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:20 trial118 ceph-mon[27812]: pgmap v317: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:22.252 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:22.439 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:22.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.645+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1234890241 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd410fa50 msgr2=0x7f4bd4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:22.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.645+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1234890241 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd410fa50 0x7f4bd4114a90 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=15528251607105754318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bc80099a0 tx=0x7f4bc802ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:22.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.645+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1234890241 shutdown_connections 2026-02-13T01:28:22.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.645+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1234890241 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4bd4115270 0x7f4bd4175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.645+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1234890241 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd410fa50 0x7f4bd4114a90 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=15528251607105754318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.645+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1234890241 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4bd410f060 0x7f4bd410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.647 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.645+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1234890241 >> 10.20.193.40:0/1234890241 conn(0x7f4bd40ec980 msgr2=0x7f4bd410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:22.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.645+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1234890241 shutdown_connections 2026-02-13T01:28:22.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.645+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1234890241 wait complete. 2026-02-13T01:28:22.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bda4206c0 1 Processor -- start 2026-02-13T01:28:22.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bda4206c0 1 -- start start 2026-02-13T01:28:22.649 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bda4206c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4bd410f060 0x7f4bd40f4810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bda4206c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd4115270 0x7f4bd4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bda4206c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4bd40f4e40 0x7f4bd40fa0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bda4206c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40f5530 con 0x7f4bd4115270 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bda4206c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40fa600 con 0x7f4bd40f4e40 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bda4206c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40fa7c0 con 0x7f4bd410f060 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd8c1d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd4115270 0x7f4bd4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd8c1d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd4115270 0x7f4bd4175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:37158/0 (socket says 10.20.193.40:37158) 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd8c1d6c0 1 -- 10.20.193.40:0/1302483531 learned_addr learned my addr 10.20.193.40:0/1302483531 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd9c1f6c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4bd40f4e40 0x7f4bd40fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:22.650 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd941e6c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4bd410f060 0x7f4bd40f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd8c1d6c0 1 -- 10.20.193.40:0/1302483531 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4bd410f060 msgr2=0x7f4bd40f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd8c1d6c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4bd410f060 0x7f4bd40f4810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd8c1d6c0 1 -- 10.20.193.40:0/1302483531 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4bd40f4e40 msgr2=0x7f4bd40fa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd8c1d6c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4bd40f4e40 0x7f4bd40fa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.646+0000 7f4bd8c1d6c0 1 -- 10.20.193.40:0/1302483531 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc8009590 con 0x7f4bd4115270 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.647+0000 7f4bd8c1d6c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd4115270 0x7f4bd4175b10 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bc80092e0 tx=0x7f4bc802f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.647+0000 7f4bc27fc6c0 1 -- 10.20.193.40:0/1302483531 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bc80046b0 con 0x7f4bd4115270 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.647+0000 7f4bc27fc6c0 1 -- 10.20.193.40:0/1302483531 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4bc8002be0 con 0x7f4bd4115270 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.647+0000 7f4bc27fc6c0 1 -- 10.20.193.40:0/1302483531 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bc80073f0 con 0x7f4bd4115270 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.647+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd40faa40 con 0x7f4bd4115270 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.647+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd40fae70 con 0x7f4bd4115270 2026-02-13T01:28:22.651 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.647+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd4110330 con 0x7f4bd4115270 2026-02-13T01:28:22.652 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.650+0000 7f4bc27fc6c0 1 -- 10.20.193.40:0/1302483531 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4bc80026b0 con 0x7f4bd4115270 2026-02-13T01:28:22.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.651+0000 7f4bc27fc6c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4bb00b56d0 0x7f4bb00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:22.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.651+0000 7f4bc27fc6c0 1 -- 10.20.193.40:0/1302483531 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f4bc8107b80 con 0x7f4bd4115270 2026-02-13T01:28:22.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.652+0000 7f4bd941e6c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4bb00b56d0 0x7f4bb00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:22.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.652+0000 7f4bc27fc6c0 1 -- 10.20.193.40:0/1302483531 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4bc81405e0 con 0x7f4bd4115270 2026-02-13T01:28:22.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.652+0000 7f4bd941e6c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4bb00b56d0 0x7f4bb00d5b80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bc4005fd0 tx=0x7f4bc40093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:22.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.776+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4bd410f430 con 0x7f4bd4115270 2026-02-13T01:28:22.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.777+0000 7f4bc27fc6c0 1 -- 10.20.193.40:0/1302483531 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4bc80ca520 con 0x7f4bd4115270 2026-02-13T01:28:22.778 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:22.778 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:22.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4bb00b56d0 msgr2=0x7f4bb00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:22.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4bb00b56d0 0x7f4bb00d5b80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bc4005fd0 tx=0x7f4bc40093f0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd4115270 msgr2=0x7f4bd4175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd4115270 0x7f4bd4175b10 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bc80092e0 tx=0x7f4bc802f810 comp rx=0 tx=0).stop 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 shutdown_connections 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f4bb00b56d0 0x7f4bb00d5b80 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f4bd40f4e40 0x7f4bd40fa0c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4bd4115270 0x7f4bd4175b10 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 --2- 10.20.193.40:0/1302483531 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f4bd410f060 0x7f4bd40f4810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 >> 10.20.193.40:0/1302483531 conn(0x7f4bd40ec980 msgr2=0x7f4bd410d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 shutdown_connections 2026-02-13T01:28:22.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:22.778+0000 7f4bda4206c0 1 -- 10.20.193.40:0/1302483531 wait complete. 2026-02-13T01:28:23.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:22 trial055 ceph-mon[27509]: pgmap v318: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:23.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:22 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1302483531' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:23.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:22 trial040 ceph-mon[23046]: pgmap v318: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:23.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:22 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1302483531' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:23.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:22 trial118 ceph-mon[27812]: pgmap v318: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:23.254 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:22 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1302483531' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:25.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:24 trial055 ceph-mon[27509]: pgmap v319: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:25.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:24 trial040 ceph-mon[23046]: pgmap v319: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:25.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:24 trial118 ceph-mon[27812]: pgmap v319: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:25.881 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:26.066 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:26.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.272+0000 7fde28c686c0 1 -- 10.20.193.40:0/3519518866 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 msgr2=0x7fde24175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:26.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.272+0000 7fde28c686c0 1 --2- 10.20.193.40:0/3519518866 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 0x7fde24175db0 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=1362086176658366858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde1400aa70 tx=0x7fde1402fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.272+0000 7fde28c686c0 1 -- 10.20.193.40:0/3519518866 shutdown_connections 2026-02-13T01:28:26.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.272+0000 7fde28c686c0 1 --2- 10.20.193.40:0/3519518866 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 0x7fde24175db0 unknown :-1 s=CLOSED pgs=364 gs=1 cs=0 l=1 c_cookie=1362086176658366858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.272+0000 7fde28c686c0 1 --2- 10.20.193.40:0/3519518866 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fde2410fbf0 0x7fde24114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.272+0000 7fde28c686c0 1 --2- 10.20.193.40:0/3519518866 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fde2410f200 0x7fde2410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.272+0000 7fde28c686c0 1 -- 10.20.193.40:0/3519518866 >> 10.20.193.40:0/3519518866 conn(0x7fde240ecb00 msgr2=0x7fde2410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:26.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.272+0000 7fde28c686c0 1 -- 10.20.193.40:0/3519518866 shutdown_connections 2026-02-13T01:28:26.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.272+0000 7fde28c686c0 1 -- 10.20.193.40:0/3519518866 wait complete. 2026-02-13T01:28:26.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde28c686c0 1 Processor -- start 2026-02-13T01:28:26.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde28c686c0 1 -- start start 2026-02-13T01:28:26.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde28c686c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fde2410f200 0x7fde2411cf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:26.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde28c686c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 0x7fde2411d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:26.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde28c686c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fde24122800 0x7fde24122ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde28c686c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fde24123210 con 0x7fde24115410 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde28c686c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fde24123380 con 0x7fde24122800 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde28c686c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fde24123540 con 0x7fde2410f200 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde21d746c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 0x7fde2411d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde21d746c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 0x7fde2411d440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:37178/0 (socket says 10.20.193.40:37178) 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde21d746c0 1 -- 10.20.193.40:0/963386961 learned_addr learned my addr 10.20.193.40:0/963386961 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde225756c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fde2410f200 0x7fde2411cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde22d766c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fde24122800 0x7fde24122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde21d746c0 1 -- 10.20.193.40:0/963386961 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fde2410f200 msgr2=0x7fde2411cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:26.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde21d746c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fde2410f200 0x7fde2411cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde21d746c0 1 -- 10.20.193.40:0/963386961 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fde24122800 msgr2=0x7fde24122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde21d746c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fde24122800 0x7fde24122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.273+0000 7fde21d746c0 1 -- 10.20.193.40:0/963386961 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1400a660 con 0x7fde24115410 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.274+0000 7fde21d746c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 0x7fde2411d440 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde0c00b750 tx=0x7fde0c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.274+0000 7fde0b7fe6c0 1 -- 10.20.193.40:0/963386961 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde0c004a80 con 0x7fde24115410 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.274+0000 7fde0b7fe6c0 1 -- 10.20.193.40:0/963386961 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fde0c009030 con 0x7fde24115410 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.274+0000 7fde0b7fe6c0 1 -- 10.20.193.40:0/963386961 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde0c0071c0 con 0x7fde24115410 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.274+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde241639f0 con 0x7fde24115410 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.274+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde24163e80 con 0x7fde24115410 2026-02-13T01:28:26.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.274+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde241104d0 con 0x7fde24115410 2026-02-13T01:28:26.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.277+0000 7fde0b7fe6c0 1 -- 10.20.193.40:0/963386961 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fde0c005020 con 0x7fde24115410 2026-02-13T01:28:26.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.278+0000 7fde0b7fe6c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fddfc0b5650 0x7fddfc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:26.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.279+0000 7fde0b7fe6c0 1 -- 10.20.193.40:0/963386961 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fde0c0e3c00 con 0x7fde24115410 2026-02-13T01:28:26.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.279+0000 7fde225756c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fddfc0b5650 0x7fddfc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:26.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.279+0000 7fde0b7fe6c0 1 -- 10.20.193.40:0/963386961 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fde0c11c660 con 0x7fde24115410 2026-02-13T01:28:26.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.279+0000 7fde225756c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fddfc0b5650 0x7fddfc0d5b00 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde18004750 tx=0x7fde18009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:26.404 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.402+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fde2411e0b0 con 0x7fde24115410 2026-02-13T01:28:26.404 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.403+0000 7fde0b7fe6c0 1 -- 10.20.193.40:0/963386961 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fde0c0a65a0 con 0x7fde24115410 2026-02-13T01:28:26.404 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:26.404 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:26.405 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fddfc0b5650 msgr2=0x7fddfc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:26.405 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fddfc0b5650 0x7fddfc0d5b00 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde18004750 tx=0x7fde18009260 comp rx=0 tx=0).stop 2026-02-13T01:28:26.405 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 msgr2=0x7fde2411d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:26.405 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 0x7fde2411d440 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde0c00b750 tx=0x7fde0c00bc20 comp rx=0 tx=0).stop 2026-02-13T01:28:26.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 shutdown_connections 2026-02-13T01:28:26.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fddfc0b5650 0x7fddfc0d5b00 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fde24122800 0x7fde24122ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fde24115410 0x7fde2411d440 unknown :-1 s=CLOSED pgs=365 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 --2- 10.20.193.40:0/963386961 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fde2410f200 0x7fde2411cf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:26.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 >> 10.20.193.40:0/963386961 conn(0x7fde240ecb00 msgr2=0x7fde2410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:26.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 shutdown_connections 2026-02-13T01:28:26.406 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:26.404+0000 7fde28c686c0 1 -- 10.20.193.40:0/963386961 wait complete. 2026-02-13T01:28:27.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:26 trial055 ceph-mon[27509]: pgmap v320: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:27.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:26 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/963386961' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:27.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:26 trial040 ceph-mon[23046]: pgmap v320: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:27.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:26 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/963386961' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:27.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:26 trial118 ceph-mon[27812]: pgmap v320: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:27.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:26 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/963386961' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:29.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:28 trial055 ceph-mon[27509]: pgmap v321: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:29.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:28 trial040 ceph-mon[23046]: pgmap v321: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:29.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:28 trial118 ceph-mon[27812]: pgmap v321: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:29.512 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:29.697 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:29.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.884+0000 7efdf70676c0 1 -- 10.20.193.40:0/1441251947 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdf010fa50 msgr2=0x7efdf0114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:29.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.884+0000 7efdf70676c0 1 --2- 10.20.193.40:0/1441251947 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdf010fa50 0x7efdf0114a90 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=1680063491385389057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efde40099a0 tx=0x7efde402ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:29.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.884+0000 7efdf70676c0 1 -- 10.20.193.40:0/1441251947 shutdown_connections 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.884+0000 7efdf70676c0 1 --2- 10.20.193.40:0/1441251947 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efdf0115270 0x7efdf0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.884+0000 7efdf70676c0 1 --2- 10.20.193.40:0/1441251947 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdf010fa50 0x7efdf0114a90 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=1680063491385389057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.884+0000 7efdf70676c0 1 --2- 10.20.193.40:0/1441251947 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efdf010f060 0x7efdf010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.884+0000 7efdf70676c0 1 -- 10.20.193.40:0/1441251947 >> 10.20.193.40:0/1441251947 conn(0x7efdf00ec980 msgr2=0x7efdf010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.884+0000 7efdf70676c0 1 -- 10.20.193.40:0/1441251947 shutdown_connections 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.884+0000 7efdf70676c0 1 -- 10.20.193.40:0/1441251947 wait complete. 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf70676c0 1 Processor -- start 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf70676c0 1 -- start start 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf70676c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efdf010f060 0x7efdf00f4860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf70676c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdf0115270 0x7efdf0175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:29.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf70676c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efdf00f4e90 0x7efdf00fa160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf70676c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efdf00f5580 con 0x7efdf0115270 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf70676c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7efdf00fa6a0 con 0x7efdf00f4e90 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf70676c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7efdf00fa860 con 0x7efdf010f060 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf60656c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efdf010f060 0x7efdf00f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf68666c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efdf00f4e90 0x7efdf00fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf60656c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efdf010f060 0x7efdf00f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:45690/0 (socket says 10.20.193.40:45690) 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.885+0000 7efdf60656c0 1 -- 10.20.193.40:0/3243426133 learned_addr learned my addr 10.20.193.40:0/3243426133 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf58646c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdf0115270 0x7efdf0175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf68666c0 1 -- 10.20.193.40:0/3243426133 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efdf010f060 msgr2=0x7efdf00f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf68666c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efdf010f060 0x7efdf00f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf68666c0 1 -- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdf0115270 msgr2=0x7efdf0175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:29.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf68666c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdf0115270 0x7efdf0175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:29.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf68666c0 1 -- 10.20.193.40:0/3243426133 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde4009590 con 0x7efdf00f4e90 2026-02-13T01:28:29.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf58646c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdf0115270 0x7efdf0175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:28:29.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf68666c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efdf00f4e90 0x7efdf00fa160 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdec00c6f0 tx=0x7efdec00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:29.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdd77fe6c0 1 -- 10.20.193.40:0/3243426133 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdec005340 con 0x7efdf00f4e90 2026-02-13T01:28:29.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf00fab40 con 0x7efdf00f4e90 2026-02-13T01:28:29.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf00fb2d0 con 0x7efdf00f4e90 2026-02-13T01:28:29.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdd77fe6c0 1 -- 10.20.193.40:0/3243426133 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efdec003d40 con 0x7efdf00f4e90 2026-02-13T01:28:29.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.886+0000 7efdd77fe6c0 1 -- 10.20.193.40:0/3243426133 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdec00de60 con 0x7efdf00f4e90 2026-02-13T01:28:29.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.887+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf0110330 con 0x7efdf00f4e90 2026-02-13T01:28:29.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.889+0000 7efdd77fe6c0 1 -- 10.20.193.40:0/3243426133 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7efdec00d410 con 0x7efdf00f4e90 2026-02-13T01:28:29.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.891+0000 7efdd77fe6c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdcc0b56c0 0x7efdcc0d5b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:29.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.891+0000 7efdf60656c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdcc0b56c0 0x7efdcc0d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:29.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.891+0000 7efdd77fe6c0 1 -- 10.20.193.40:0/3243426133 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7efdec0e4990 con 0x7efdf00f4e90 2026-02-13T01:28:29.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.891+0000 7efdd77fe6c0 1 -- 10.20.193.40:0/3243426133 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efdec0e4e10 con 0x7efdf00f4e90 2026-02-13T01:28:29.893 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:29.891+0000 7efdf60656c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdcc0b56c0 0x7efdcc0d5b70 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efde0009260 tx=0x7efde0009440 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:30.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.015+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efdf00f59b0 con 0x7efdf00f4e90 2026-02-13T01:28:30.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.016+0000 7efdd77fe6c0 1 -- 10.20.193.40:0/3243426133 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7efdec0a7330 con 0x7efdf00f4e90 2026-02-13T01:28:30.017 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:30.017 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:30.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.016+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdcc0b56c0 msgr2=0x7efdcc0d5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:30.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.016+0000 7efdf70676c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdcc0b56c0 0x7efdcc0d5b70 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efde0009260 tx=0x7efde0009440 comp rx=0 tx=0).stop 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.016+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efdf00f4e90 msgr2=0x7efdf00fa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.016+0000 7efdf70676c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efdf00f4e90 0x7efdf00fa160 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdec00c6f0 tx=0x7efdec00cbc0 comp rx=0 tx=0).stop 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.017+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 shutdown_connections 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.017+0000 7efdf70676c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7efdcc0b56c0 0x7efdcc0d5b70 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.017+0000 7efdf70676c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7efdf00f4e90 0x7efdf00fa160 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.017+0000 7efdf70676c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdf0115270 0x7efdf0175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.017+0000 7efdf70676c0 1 --2- 10.20.193.40:0/3243426133 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7efdf010f060 0x7efdf00f4860 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.017+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 >> 10.20.193.40:0/3243426133 conn(0x7efdf00ec980 msgr2=0x7efdf010d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.017+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 shutdown_connections 2026-02-13T01:28:30.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:30.017+0000 7efdf70676c0 1 -- 10.20.193.40:0/3243426133 wait complete. 2026-02-13T01:28:31.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:30 trial055 ceph-mon[27509]: pgmap v322: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:31.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:30 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3243426133' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:31.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:30 trial040 ceph-mon[23046]: pgmap v322: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:31.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:30 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3243426133' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:31.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:30 trial118 ceph-mon[27812]: pgmap v322: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:31.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:30 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3243426133' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:33.156 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:33.208 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:32 trial040 ceph-mon[23046]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:33.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:32 trial055 ceph-mon[27509]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:33.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:32 trial118 ceph-mon[27812]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:33.342 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:33.532 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.530+0000 7f1a788406c0 1 -- 10.20.193.40:0/3289419941 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a7410fa50 msgr2=0x7f1a74114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:33.532 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.530+0000 7f1a788406c0 1 --2- 10.20.193.40:0/3289419941 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a7410fa50 0x7f1a74114a90 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=9937221215065064147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a5c0099a0 tx=0x7f1a5c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:33.532 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.530+0000 7f1a788406c0 1 -- 10.20.193.40:0/3289419941 shutdown_connections 2026-02-13T01:28:33.532 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.530+0000 7f1a788406c0 1 --2- 10.20.193.40:0/3289419941 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1a74115270 0x7f1a74175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:33.533 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.530+0000 7f1a788406c0 1 --2- 10.20.193.40:0/3289419941 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a7410fa50 0x7f1a74114a90 unknown :-1 s=CLOSED pgs=367 gs=1 cs=0 l=1 c_cookie=9937221215065064147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:33.533 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.530+0000 7f1a788406c0 1 --2- 10.20.193.40:0/3289419941 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1a7410f060 0x7f1a7410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:33.533 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.530+0000 7f1a788406c0 1 -- 10.20.193.40:0/3289419941 >> 10.20.193.40:0/3289419941 conn(0x7f1a740ec980 msgr2=0x7f1a7410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:33.533 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.530+0000 7f1a788406c0 1 -- 10.20.193.40:0/3289419941 shutdown_connections 2026-02-13T01:28:33.533 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.530+0000 7f1a788406c0 1 -- 10.20.193.40:0/3289419941 wait complete. 2026-02-13T01:28:33.533 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.531+0000 7f1a788406c0 1 Processor -- start 2026-02-13T01:28:33.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.531+0000 7f1a788406c0 1 -- start start 2026-02-13T01:28:33.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.531+0000 7f1a788406c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1a7410f060 0x7f1a740f49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:33.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.531+0000 7f1a788406c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1a74115270 0x7f1a74175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:33.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.531+0000 7f1a788406c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a740f5020 0x7f1a740fa2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:33.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.531+0000 7f1a788406c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1a740f5710 con 0x7f1a740f5020 2026-02-13T01:28:33.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.531+0000 7f1a788406c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1a740fa830 con 0x7f1a7410f060 2026-02-13T01:28:33.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.531+0000 7f1a788406c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1a740fa9f0 con 0x7f1a74115270 2026-02-13T01:28:33.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a735776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a740f5020 0x7f1a740fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:33.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a72d766c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1a7410f060 0x7f1a740f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a735776c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a740f5020 0x7f1a740fa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49306/0 (socket says 10.20.193.40:49306) 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a735776c0 1 -- 10.20.193.40:0/2190416907 learned_addr learned my addr 10.20.193.40:0/2190416907 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a725756c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1a74115270 0x7f1a74175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a735776c0 1 -- 10.20.193.40:0/2190416907 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1a74115270 msgr2=0x7f1a74175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a735776c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1a74115270 0x7f1a74175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a735776c0 1 -- 10.20.193.40:0/2190416907 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1a7410f060 msgr2=0x7f1a740f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a735776c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1a7410f060 0x7f1a740f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a735776c0 1 -- 10.20.193.40:0/2190416907 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5c009590 con 0x7f1a740f5020 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a735776c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a740f5020 0x7f1a740fa2f0 secure :-1 s=READY pgs=368 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a64006ea0 tx=0x7f1a6400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a53fff6c0 1 -- 10.20.193.40:0/2190416907 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a64003c40 con 0x7f1a740f5020 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a53fff6c0 1 -- 10.20.193.40:0/2190416907 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1a64003da0 con 0x7f1a740f5020 2026-02-13T01:28:33.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a53fff6c0 1 -- 10.20.193.40:0/2190416907 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a64008440 con 0x7f1a740f5020 2026-02-13T01:28:33.537 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a740facd0 con 0x7f1a740f5020 2026-02-13T01:28:33.537 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.532+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a740fb160 con 0x7f1a740f5020 2026-02-13T01:28:33.537 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.533+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a74110330 con 0x7f1a740f5020 2026-02-13T01:28:33.537 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.535+0000 7f1a53fff6c0 1 -- 10.20.193.40:0/2190416907 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1a6400d690 con 0x7f1a740f5020 2026-02-13T01:28:33.538 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.537+0000 7f1a53fff6c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1a480b56d0 0x7f1a480d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:33.538 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.537+0000 7f1a53fff6c0 1 -- 10.20.193.40:0/2190416907 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f1a640e4ad0 con 0x7f1a740f5020 2026-02-13T01:28:33.538 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.537+0000 7f1a53fff6c0 1 -- 10.20.193.40:0/2190416907 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1a6411d5e0 con 0x7f1a740f5020 2026-02-13T01:28:33.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.537+0000 7f1a72d766c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1a480b56d0 0x7f1a480d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:33.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.538+0000 7f1a72d766c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1a480b56d0 0x7f1a480d5b80 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a68004750 tx=0x7f1a68009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:33.662 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.661+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1a740f5b40 con 0x7f1a740f5020 2026-02-13T01:28:33.662 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.661+0000 7f1a53fff6c0 1 -- 10.20.193.40:0/2190416907 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1a640a7470 con 0x7f1a740f5020 2026-02-13T01:28:33.663 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:33.663 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:33.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1a480b56d0 msgr2=0x7f1a480d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:33.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1a480b56d0 0x7f1a480d5b80 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a68004750 tx=0x7f1a68009260 comp rx=0 tx=0).stop 2026-02-13T01:28:33.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a740f5020 msgr2=0x7f1a740fa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:33.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a740f5020 0x7f1a740fa2f0 secure :-1 s=READY pgs=368 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a64006ea0 tx=0x7f1a6400ce50 comp rx=0 tx=0).stop 2026-02-13T01:28:33.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 shutdown_connections 2026-02-13T01:28:33.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f1a480b56d0 0x7f1a480d5b80 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:33.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1a740f5020 0x7f1a740fa2f0 unknown :-1 s=CLOSED pgs=368 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:33.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f1a74115270 0x7f1a74175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:33.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 --2- 10.20.193.40:0/2190416907 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f1a7410f060 0x7f1a740f49f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:33.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 >> 10.20.193.40:0/2190416907 conn(0x7f1a740ec980 msgr2=0x7f1a7410d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:33.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.662+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 shutdown_connections 2026-02-13T01:28:33.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:33.663+0000 7f1a788406c0 1 -- 10.20.193.40:0/2190416907 wait complete. 2026-02-13T01:28:33.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:33 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2190416907' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:34.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:33 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2190416907' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:34.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:33 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2190416907' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:35.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:34 trial055 ceph-mon[27509]: pgmap v324: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:35.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:34 trial040 ceph-mon[23046]: pgmap v324: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:35.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:34 trial118 ceph-mon[27812]: pgmap v324: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:36.764 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:36.949 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:37.080 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:36 trial040 ceph-mon[23046]: pgmap v325: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:37.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.140+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/3834762267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1b410f060 msgr2=0x7fa1b410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:37.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.140+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/3834762267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1b410f060 0x7fa1b410f430 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=2989504802545467910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1a40099a0 tx=0x7fa1a402ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:37.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.140+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/3834762267 shutdown_connections 2026-02-13T01:28:37.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.140+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/3834762267 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1b4115270 0x7fa1b4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.140+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/3834762267 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1b410fa50 0x7fa1b4114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.140+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/3834762267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1b410f060 0x7fa1b410f430 unknown :-1 s=CLOSED pgs=369 gs=1 cs=0 l=1 c_cookie=2989504802545467910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.140+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/3834762267 >> 10.20.193.40:0/3834762267 conn(0x7fa1b40ec980 msgr2=0x7fa1b410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:37.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.140+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/3834762267 shutdown_connections 2026-02-13T01:28:37.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.140+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/3834762267 wait complete. 2026-02-13T01:28:37.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.141+0000 7fa1b987b6c0 1 Processor -- start 2026-02-13T01:28:37.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.141+0000 7fa1b987b6c0 1 -- start start 2026-02-13T01:28:37.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.141+0000 7fa1b987b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1b410f060 0x7fa1b411ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:37.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.141+0000 7fa1b987b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1b4115270 0x7fa1b411d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.141+0000 7fa1b987b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1b4122700 0x7fa1b4122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.141+0000 7fa1b987b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b4123110 con 0x7fa1b4122700 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.141+0000 7fa1b987b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b4123280 con 0x7fa1b4115270 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.141+0000 7fa1b987b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b4123440 con 0x7fa1b410f060 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1abfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1b4115270 0x7fa1b411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1abfff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1b4115270 0x7fa1b411d340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:51578/0 (socket says 10.20.193.40:51578) 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1abfff6c0 1 -- 10.20.193.40:0/4217252448 learned_addr learned my addr 10.20.193.40:0/4217252448 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1b88796c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1b410f060 0x7fa1b411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1b907a6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1b4122700 0x7fa1b4122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1abfff6c0 1 -- 10.20.193.40:0/4217252448 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1b410f060 msgr2=0x7fa1b411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1abfff6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1b410f060 0x7fa1b411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1abfff6c0 1 -- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1b4122700 msgr2=0x7fa1b4122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1abfff6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1b4122700 0x7fa1b4122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1abfff6c0 1 -- 10.20.193.40:0/4217252448 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a4009590 con 0x7fa1b4115270 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1b907a6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1b4122700 0x7fa1b4122ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1abfff6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1b4115270 0x7fa1b411d340 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa19c00b750 tx=0x7fa19c00bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1a9ffb6c0 1 -- 10.20.193.40:0/4217252448 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa19c004a80 con 0x7fa1b4115270 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1a9ffb6c0 1 -- 10.20.193.40:0/4217252448 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa19c009030 con 0x7fa1b4115270 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b41638f0 con 0x7fa1b4115270 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b4163d80 con 0x7fa1b4115270 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.142+0000 7fa1a9ffb6c0 1 -- 10.20.193.40:0/4217252448 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa19c0071c0 con 0x7fa1b4115270 2026-02-13T01:28:37.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.143+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b4110330 con 0x7fa1b4115270 2026-02-13T01:28:37.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.145+0000 7fa1a9ffb6c0 1 -- 10.20.193.40:0/4217252448 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa19c005020 con 0x7fa1b4115270 2026-02-13T01:28:37.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.146+0000 7fa1a9ffb6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1900b5650 0x7fa1900d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:37.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.146+0000 7fa1a9ffb6c0 1 -- 10.20.193.40:0/4217252448 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fa19c0e3c20 con 0x7fa1b4115270 2026-02-13T01:28:37.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.147+0000 7fa1b88796c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1900b5650 0x7fa1900d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:37.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.147+0000 7fa1a9ffb6c0 1 -- 10.20.193.40:0/4217252448 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa19c11c680 con 0x7fa1b4115270 2026-02-13T01:28:37.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.147+0000 7fa1b88796c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1900b5650 0x7fa1900d5b00 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1a4005b40 tx=0x7fa1a40023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:37.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:36 trial055 ceph-mon[27509]: pgmap v325: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:37.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:36 trial118 ceph-mon[27812]: pgmap v325: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:37.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.271+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa1b411df80 con 0x7fa1b4115270 2026-02-13T01:28:37.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.272+0000 7fa1a9ffb6c0 1 -- 10.20.193.40:0/4217252448 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa19c0a65c0 con 0x7fa1b4115270 2026-02-13T01:28:37.273 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:37.273 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:37.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1900b5650 msgr2=0x7fa1900d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:37.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1900b5650 0x7fa1900d5b00 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1a4005b40 tx=0x7fa1a40023a0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1b4115270 msgr2=0x7fa1b411d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:37.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1b4115270 0x7fa1b411d340 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa19c00b750 tx=0x7fa19c00bc20 comp rx=0 tx=0).stop 2026-02-13T01:28:37.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 shutdown_connections 2026-02-13T01:28:37.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fa1900b5650 0x7fa1900d5b00 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1b4122700 0x7fa1b4122ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fa1b4115270 0x7fa1b411d340 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 --2- 10.20.193.40:0/4217252448 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fa1b410f060 0x7fa1b411ce00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:37.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 >> 10.20.193.40:0/4217252448 conn(0x7fa1b40ec980 msgr2=0x7fa1b410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:37.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 shutdown_connections 2026-02-13T01:28:37.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:37.273+0000 7fa1b987b6c0 1 -- 10.20.193.40:0/4217252448 wait complete. 2026-02-13T01:28:38.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:37 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/4217252448' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:38.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:37 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/4217252448' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:38.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:37 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/4217252448' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:39.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:38 trial055 ceph-mon[27509]: pgmap v326: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:39.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:38 trial040 ceph-mon[23046]: pgmap v326: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:39.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:38 trial118 ceph-mon[27812]: pgmap v326: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:40.378 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:40.565 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:40.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.758+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/391623503 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410fa50 msgr2=0x7f7f24114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:40.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.758+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/391623503 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410fa50 0x7f7f24114a90 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=7386972473149455369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f0c0099a0 tx=0x7f7f0c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:40.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.758+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/391623503 shutdown_connections 2026-02-13T01:28:40.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.758+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/391623503 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f24115270 0x7f7f24175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.758+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/391623503 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410fa50 0x7f7f24114a90 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=7386972473149455369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.758+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/391623503 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f2410f060 0x7f7f2410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.758+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/391623503 >> 10.20.193.40:0/391623503 conn(0x7f7f240ec980 msgr2=0x7f7f2410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:40.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.758+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/391623503 shutdown_connections 2026-02-13T01:28:40.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.758+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/391623503 wait complete. 2026-02-13T01:28:40.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f23fff6c0 1 Processor -- start 2026-02-13T01:28:40.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f23fff6c0 1 -- start start 2026-02-13T01:28:40.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f23fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410f060 0x7f7f2411cee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:40.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f23fff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f24115270 0x7f7f2411d420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:40.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f23fff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f241227e0 0x7f7f24122c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:40.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f23fff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241231f0 con 0x7f7f2410f060 2026-02-13T01:28:40.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f23fff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7f24123360 con 0x7f7f24115270 2026-02-13T01:28:40.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f23fff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7f24123520 con 0x7f7f241227e0 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f22ffd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410f060 0x7f7f2411cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f227fc6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f24115270 0x7f7f2411d420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f22ffd6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410f060 0x7f7f2411cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:44472/0 (socket says 10.20.193.40:44472) 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.759+0000 7f7f22ffd6c0 1 -- 10.20.193.40:0/3159622749 learned_addr learned my addr 10.20.193.40:0/3159622749 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f237fe6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f241227e0 0x7f7f24122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f22ffd6c0 1 -- 10.20.193.40:0/3159622749 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f241227e0 msgr2=0x7f7f24122c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f22ffd6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f241227e0 0x7f7f24122c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f22ffd6c0 1 -- 10.20.193.40:0/3159622749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f24115270 msgr2=0x7f7f2411d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f22ffd6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f24115270 0x7f7f2411d420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f22ffd6c0 1 -- 10.20.193.40:0/3159622749 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c009590 con 0x7f7f2410f060 2026-02-13T01:28:40.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f22ffd6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410f060 0x7f7f2411cee0 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f18005dc0 tx=0x7f7f1800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:40.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f03fff6c0 1 -- 10.20.193.40:0/3159622749 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f18004250 con 0x7f7f2410f060 2026-02-13T01:28:40.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f03fff6c0 1 -- 10.20.193.40:0/3159622749 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7f18009070 con 0x7f7f2410f060 2026-02-13T01:28:40.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f03fff6c0 1 -- 10.20.193.40:0/3159622749 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f180071c0 con 0x7f7f2410f060 2026-02-13T01:28:40.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f241639d0 con 0x7f7f2410f060 2026-02-13T01:28:40.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.760+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f24163e60 con 0x7f7f2410f060 2026-02-13T01:28:40.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.761+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f24110330 con 0x7f7f2410f060 2026-02-13T01:28:40.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.763+0000 7f7f03fff6c0 1 -- 10.20.193.40:0/3159622749 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f7f180043b0 con 0x7f7f2410f060 2026-02-13T01:28:40.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.765+0000 7f7f03fff6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ef40b56d0 0x7f7ef40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:40.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.765+0000 7f7f03fff6c0 1 -- 10.20.193.40:0/3159622749 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f7f180e3bd0 con 0x7f7f2410f060 2026-02-13T01:28:40.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.765+0000 7f7f03fff6c0 1 -- 10.20.193.40:0/3159622749 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7f1811c5e0 con 0x7f7f2410f060 2026-02-13T01:28:40.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.765+0000 7f7f227fc6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ef40b56d0 0x7f7ef40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:40.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.765+0000 7f7f227fc6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ef40b56d0 0x7f7ef40d5b80 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f24123870 tx=0x7f7f0c0023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:40.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.888+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7f2410f430 con 0x7f7f2410f060 2026-02-13T01:28:40.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.888+0000 7f7f03fff6c0 1 -- 10.20.193.40:0/3159622749 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7f180a6570 con 0x7f7f2410f060 2026-02-13T01:28:40.890 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:40.890 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:40.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ef40b56d0 msgr2=0x7f7ef40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:40.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ef40b56d0 0x7f7ef40d5b80 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f24123870 tx=0x7f7f0c0023a0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410f060 msgr2=0x7f7f2411cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:40.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410f060 0x7f7f2411cee0 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f18005dc0 tx=0x7f7f1800bbb0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 shutdown_connections 2026-02-13T01:28:40.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f7ef40b56d0 0x7f7ef40d5b80 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f7f241227e0 0x7f7f24122c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f7f24115270 0x7f7f2411d420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 --2- 10.20.193.40:0/3159622749 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f2410f060 0x7f7f2411cee0 unknown :-1 s=CLOSED pgs=371 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:40.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 >> 10.20.193.40:0/3159622749 conn(0x7f7f240ec980 msgr2=0x7f7f2410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:40.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 shutdown_connections 2026-02-13T01:28:40.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:40.890+0000 7f7f23fff6c0 1 -- 10.20.193.40:0/3159622749 wait complete. 2026-02-13T01:28:40.950 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:40 trial040 ceph-mon[23046]: pgmap v327: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:41.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:40 trial055 ceph-mon[27509]: pgmap v327: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:41.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:40 trial118 ceph-mon[27812]: pgmap v327: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:42.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:41 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3159622749' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:42.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:41 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3159622749' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:42.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:41 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3159622749' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:43.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:42 trial055 ceph-mon[27509]: pgmap v328: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:43.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:42 trial040 ceph-mon[23046]: pgmap v328: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:43.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:42 trial118 ceph-mon[27812]: pgmap v328: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:43.994 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:44.178 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:44.373 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.371+0000 7fd7e27076c0 1 -- 10.20.193.40:0/3176683512 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7dc155600 msgr2=0x7fd7dc1759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:44.373 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.371+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/3176683512 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7dc155600 0x7fd7dc1759e0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=6913118829441863744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7d800aa40 tx=0x7fd7d802fdf0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.373 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.371+0000 7fd7e27076c0 1 -- 10.20.193.40:0/3176683512 shutdown_connections 2026-02-13T01:28:44.373 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.371+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/3176683512 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7dc155600 0x7fd7dc1759e0 unknown :-1 s=CLOSED pgs=372 gs=1 cs=0 l=1 c_cookie=6913118829441863744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.373 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.371+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/3176683512 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7dc10c1e0 0x7fd7dc1550c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.373 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.371+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/3176683512 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7dc10b8d0 0x7fd7dc10bca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.373 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.371+0000 7fd7e27076c0 1 -- 10.20.193.40:0/3176683512 >> 10.20.193.40:0/3176683512 conn(0x7fd7dc0e9590 msgr2=0x7fd7dc1099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:44.374 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.371+0000 7fd7e27076c0 1 -- 10.20.193.40:0/3176683512 shutdown_connections 2026-02-13T01:28:44.374 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.371+0000 7fd7e27076c0 1 -- 10.20.193.40:0/3176683512 wait complete. 2026-02-13T01:28:44.374 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e27076c0 1 Processor -- start 2026-02-13T01:28:44.374 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e27076c0 1 -- start start 2026-02-13T01:28:44.375 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e27076c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7dc10b8d0 0x7fd7dc1600b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:44.375 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e27076c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7dc10c1e0 0x7fd7dc1605f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:44.375 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e27076c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7dc155600 0x7fd7dc1659b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e27076c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc166000 con 0x7fd7dc155600 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e27076c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc166170 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e27076c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc166330 con 0x7fd7dc10b8d0 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e1f066c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7dc155600 0x7fd7dc1659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e0f046c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7dc10c1e0 0x7fd7dc1605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e17056c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7dc10b8d0 0x7fd7dc1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e0f046c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7dc10c1e0 0x7fd7dc1605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:47696/0 (socket says 10.20.193.40:47696) 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.372+0000 7fd7e0f046c0 1 -- 10.20.193.40:0/86664892 learned_addr learned my addr 10.20.193.40:0/86664892 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7e0f046c0 1 -- 10.20.193.40:0/86664892 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7dc10b8d0 msgr2=0x7fd7dc1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:44.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7e0f046c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7dc10b8d0 0x7fd7dc1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7e0f046c0 1 -- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7dc155600 msgr2=0x7fd7dc1659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7e0f046c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7dc155600 0x7fd7dc1659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7e0f046c0 1 -- 10.20.193.40:0/86664892 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d800a660 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7e1f066c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7dc155600 0x7fd7dc1659b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7e0f046c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7dc10c1e0 0x7fd7dc1605f0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7d0009490 tx=0x7fd7d000bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7ca7fc6c0 1 -- 10.20.193.40:0/86664892 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7d0004a80 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7dc166610 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7ca7fc6c0 1 -- 10.20.193.40:0/86664892 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd7d0009030 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7ca7fc6c0 1 -- 10.20.193.40:0/86664892 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7d0007440 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.373+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7dc152240 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.374+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7dc05fb10 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.376+0000 7fd7ca7fc6c0 1 -- 10.20.193.40:0/86664892 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fd7d0004060 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.379 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.378+0000 7fd7ca7fc6c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7b80b5650 0x7fd7b80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:44.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.378+0000 7fd7ca7fc6c0 1 -- 10.20.193.40:0/86664892 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fd7d00e3ab0 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.378+0000 7fd7e17056c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7b80b5650 0x7fd7b80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:44.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.378+0000 7fd7ca7fc6c0 1 -- 10.20.193.40:0/86664892 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd7d011c5e0 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.380 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.379+0000 7fd7e17056c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7b80b5650 0x7fd7b80d5b00 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7cc004750 tx=0x7fd7cc009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:44.505 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.504+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd7dc10bca0 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.505 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.504+0000 7fd7ca7fc6c0 1 -- 10.20.193.40:0/86664892 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd7d00a6450 con 0x7fd7dc10c1e0 2026-02-13T01:28:44.506 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:44.506 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:44.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.505+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7b80b5650 msgr2=0x7fd7b80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:44.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.505+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7b80b5650 0x7fd7b80d5b00 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7cc004750 tx=0x7fd7cc009260 comp rx=0 tx=0).stop 2026-02-13T01:28:44.507 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.505+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7dc10c1e0 msgr2=0x7fd7dc1605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:44.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.505+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7dc10c1e0 0x7fd7dc1605f0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7d0009490 tx=0x7fd7d000bca0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.506+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 shutdown_connections 2026-02-13T01:28:44.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.506+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd7b80b5650 0x7fd7b80d5b00 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.506+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd7dc155600 0x7fd7dc1659b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.506+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd7dc10c1e0 0x7fd7dc1605f0 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.506+0000 7fd7e27076c0 1 --2- 10.20.193.40:0/86664892 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd7dc10b8d0 0x7fd7dc1600b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:44.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.506+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 >> 10.20.193.40:0/86664892 conn(0x7fd7dc0e9590 msgr2=0x7fd7dc109970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:44.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.506+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 shutdown_connections 2026-02-13T01:28:44.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:44.506+0000 7fd7e27076c0 1 -- 10.20.193.40:0/86664892 wait complete. 2026-02-13T01:28:45.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:44 trial055 ceph-mon[27509]: pgmap v329: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:45.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:44 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/86664892' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:45.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:44 trial040 ceph-mon[23046]: pgmap v329: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:45.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:44 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/86664892' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:45.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:44 trial118 ceph-mon[27812]: pgmap v329: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:45.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:44 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/86664892' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:47.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:46 trial055 ceph-mon[27509]: pgmap v330: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:47.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:46 trial040 ceph-mon[23046]: pgmap v330: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:47.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:46 trial118 ceph-mon[27812]: pgmap v330: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:47.610 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:47.797 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:47.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.987+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2464892215 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8374115270 msgr2=0x7f8374175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:47.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.987+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2464892215 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8374115270 0x7f8374175c10 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=17704434114944318858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f837000aa70 tx=0x7f837002fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:47.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.987+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2464892215 shutdown_connections 2026-02-13T01:28:47.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.987+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2464892215 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8374115270 0x7f8374175c10 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=17704434114944318858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:47.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.987+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2464892215 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f837410fa50 0x7f8374114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:47.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.987+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2464892215 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f837410f060 0x7f837410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:47.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.987+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2464892215 >> 10.20.193.40:0/2464892215 conn(0x7f83740ec980 msgr2=0x7f837410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:47.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.987+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2464892215 shutdown_connections 2026-02-13T01:28:47.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.987+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2464892215 wait complete. 2026-02-13T01:28:47.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f837a7b36c0 1 Processor -- start 2026-02-13T01:28:47.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f837a7b36c0 1 -- start start 2026-02-13T01:28:47.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f837a7b36c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f837410f060 0x7f837411cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:47.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f837a7b36c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8374115270 0x7f837411d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:47.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f837a7b36c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8374122690 0x7f8374122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f837a7b36c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f83741230a0 con 0x7f8374122690 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f837a7b36c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8374123210 con 0x7f837410f060 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f837a7b36c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f83741233d0 con 0x7f8374115270 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f83797b16c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f837410f060 0x7f837411cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f8378fb06c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8374115270 0x7f837411d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f8379fb26c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8374122690 0x7f8374122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f8378fb06c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8374115270 0x7f837411d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.118:3300/0 says I am v2:10.20.193.40:33602/0 (socket says 10.20.193.40:33602) 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f8378fb06c0 1 -- 10.20.193.40:0/2804637151 learned_addr learned my addr 10.20.193.40:0/2804637151 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.988+0000 7f83797b16c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f837410f060 0x7f837411cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:47718/0 (socket says 10.20.193.40:47718) 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f83797b16c0 1 -- 10.20.193.40:0/2804637151 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8374115270 msgr2=0x7f837411d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f83797b16c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8374115270 0x7f837411d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:47.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f83797b16c0 1 -- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8374122690 msgr2=0x7f8374122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f83797b16c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8374122690 0x7f8374122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f83797b16c0 1 -- 10.20.193.40:0/2804637151 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837000a660 con 0x7f837410f060 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f8378fb06c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8374115270 0x7f837411d2d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f8379fb26c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8374122690 0x7f8374122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f83797b16c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f837410f060 0x7f837411cd90 secure :-1 s=READY pgs=118 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f836400b6c0 tx=0x7f836400bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f83627fc6c0 1 -- 10.20.193.40:0/2804637151 <== mon.2 v2:10.20.193.55:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8364004520 con 0x7f837410f060 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f83627fc6c0 1 -- 10.20.193.40:0/2804637151 <== mon.2 v2:10.20.193.55:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8364009030 con 0x7f837410f060 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f83627fc6c0 1 -- 10.20.193.40:0/2804637151 <== mon.2 v2:10.20.193.55:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f836400ce40 con 0x7f837410f060 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8374163880 con 0x7f837410f060 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.989+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8374163d10 con 0x7f837410f060 2026-02-13T01:28:47.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.990+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8374110330 con 0x7f837410f060 2026-02-13T01:28:47.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.992+0000 7f83627fc6c0 1 -- 10.20.193.40:0/2804637151 <== mon.2 v2:10.20.193.55:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f836400c410 con 0x7f837410f060 2026-02-13T01:28:47.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.993+0000 7f83627fc6c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f83500b56d0 0x7f83500d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:47.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.994+0000 7f83627fc6c0 1 -- 10.20.193.40:0/2804637151 <== mon.2 v2:10.20.193.55:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f83640e3960 con 0x7f837410f060 2026-02-13T01:28:47.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.994+0000 7f8378fb06c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f83500b56d0 0x7f83500d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:47.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.994+0000 7f83627fc6c0 1 -- 10.20.193.40:0/2804637151 <== mon.2 v2:10.20.193.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f83640e3de0 con 0x7f837410f060 2026-02-13T01:28:47.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:47.994+0000 7f8378fb06c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f83500b56d0 0x7f83500d5b80 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8374123720 tx=0x7f8368009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:48.118 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.116+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f837410f430 con 0x7f837410f060 2026-02-13T01:28:48.118 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.117+0000 7f83627fc6c0 1 -- 10.20.193.40:0/2804637151 <== mon.2 v2:10.20.193.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f83640a6300 con 0x7f837410f060 2026-02-13T01:28:48.118 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:48.118 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:48.119 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f83500b56d0 msgr2=0x7f83500d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:48.119 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f83500b56d0 0x7f83500d5b80 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8374123720 tx=0x7f8368009260 comp rx=0 tx=0).stop 2026-02-13T01:28:48.119 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f837410f060 msgr2=0x7f837411cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:48.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f837410f060 0x7f837411cd90 secure :-1 s=READY pgs=118 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f836400b6c0 tx=0x7f836400bb90 comp rx=0 tx=0).stop 2026-02-13T01:28:48.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 shutdown_connections 2026-02-13T01:28:48.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f83500b56d0 0x7f83500d5b80 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:48.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8374122690 0x7f8374122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:48.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f8374115270 0x7f837411d2d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:48.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 --2- 10.20.193.40:0/2804637151 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f837410f060 0x7f837411cd90 unknown :-1 s=CLOSED pgs=118 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:48.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 >> 10.20.193.40:0/2804637151 conn(0x7f83740ec980 msgr2=0x7f837410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:48.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 shutdown_connections 2026-02-13T01:28:48.120 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:48.118+0000 7f837a7b36c0 1 -- 10.20.193.40:0/2804637151 wait complete. 2026-02-13T01:28:49.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:48 trial055 ceph-mon[27509]: pgmap v331: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:49.242 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:48 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2804637151' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:49.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:48 trial040 ceph-mon[23046]: pgmap v331: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:49.249 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:48 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2804637151' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:49.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:48 trial118 ceph-mon[27812]: pgmap v331: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:49.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:48 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2804637151' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:51.221 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:51.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:50 trial055 ceph-mon[27509]: pgmap v332: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:51.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:50 trial040 ceph-mon[23046]: pgmap v332: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:51.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:50 trial118 ceph-mon[27812]: pgmap v332: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:51.401 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:51.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/2335909778 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13f8115410 msgr2=0x7f13f8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:51.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/2335909778 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13f8115410 0x7f13f8175db0 secure :-1 s=READY pgs=374 gs=3 cs=0 l=1 c_cookie=13836626233128262223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13e800aa70 tx=0x7f13e802fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.598 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/2335909778 shutdown_connections 2026-02-13T01:28:51.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/2335909778 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13f8115410 0x7f13f8175db0 unknown :-1 s=CLOSED pgs=374 gs=3 cs=0 l=1 c_cookie=13836626233128262223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/2335909778 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f13f810fbf0 0x7f13f8114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/2335909778 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f13f810f200 0x7f13f810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/2335909778 >> 10.20.193.40:0/2335909778 conn(0x7f13f80ecb00 msgr2=0x7f13f810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:51.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/2335909778 shutdown_connections 2026-02-13T01:28:51.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/2335909778 wait complete. 2026-02-13T01:28:51.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.597+0000 7f13fcb7c6c0 1 Processor -- start 2026-02-13T01:28:51.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13fcb7c6c0 1 -- start start 2026-02-13T01:28:51.601 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13fcb7c6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f13f810f200 0x7f13f811cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13fcb7c6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13f8115410 0x7f13f811d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13fcb7c6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f13f8122810 0x7f13f8122cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13fcb7c6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f13f8123220 con 0x7f13f8115410 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13fcb7c6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f13f8123390 con 0x7f13f810f200 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13fcb7c6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13f8123550 con 0x7f13f8122810 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f65756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f13f810f200 0x7f13f811cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f65756c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f13f810f200 0x7f13f811cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:58818/0 (socket says 10.20.193.40:58818) 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f65756c0 1 -- 10.20.193.40:0/670028317 learned_addr learned my addr 10.20.193.40:0/670028317 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f5d746c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13f8115410 0x7f13f811d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f6d766c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f13f8122810 0x7f13f8122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:51.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f5d746c0 1 -- 10.20.193.40:0/670028317 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f13f8122810 msgr2=0x7f13f8122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f5d746c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f13f8122810 0x7f13f8122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f5d746c0 1 -- 10.20.193.40:0/670028317 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f13f810f200 msgr2=0x7f13f811cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f5d746c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f13f810f200 0x7f13f811cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f5d746c0 1 -- 10.20.193.40:0/670028317 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e800a660 con 0x7f13f8115410 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.598+0000 7f13f5d746c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13f8115410 0x7f13f811d4a0 secure :-1 s=READY pgs=375 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13e0004750 tx=0x7f13e000bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.599+0000 7f13df7fe6c0 1 -- 10.20.193.40:0/670028317 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13e0004a80 con 0x7f13f8115410 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.599+0000 7f13df7fe6c0 1 -- 10.20.193.40:0/670028317 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f13e0009030 con 0x7f13f8115410 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.599+0000 7f13df7fe6c0 1 -- 10.20.193.40:0/670028317 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13e00071c0 con 0x7f13f8115410 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.599+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f8163a00 con 0x7f13f8115410 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.599+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f8163e90 con 0x7f13f8115410 2026-02-13T01:28:51.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.600+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f81104d0 con 0x7f13f8115410 2026-02-13T01:28:51.604 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.601+0000 7f13df7fe6c0 1 -- 10.20.193.40:0/670028317 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f13e00026b0 con 0x7f13f8115410 2026-02-13T01:28:51.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.603+0000 7f13df7fe6c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f13d00b56d0 0x7f13d00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:51.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.603+0000 7f13df7fe6c0 1 -- 10.20.193.40:0/670028317 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f13e00e3c00 con 0x7f13f8115410 2026-02-13T01:28:51.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.603+0000 7f13f65756c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f13d00b56d0 0x7f13d00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:51.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.604+0000 7f13df7fe6c0 1 -- 10.20.193.40:0/670028317 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f13e00a65a0 con 0x7f13f8115410 2026-02-13T01:28:51.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.604+0000 7f13f65756c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f13d00b56d0 0x7f13d00d5b80 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13ec0095e0 tx=0x7f13ec009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:51.729 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.728+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f13f810f5d0 con 0x7f13f8115410 2026-02-13T01:28:51.730 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.728+0000 7f13df7fe6c0 1 -- 10.20.193.40:0/670028317 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f13e00a9750 con 0x7f13f8115410 2026-02-13T01:28:51.730 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:51.730 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:51.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f13d00b56d0 msgr2=0x7f13d00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:51.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f13d00b56d0 0x7f13d00d5b80 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13ec0095e0 tx=0x7f13ec009260 comp rx=0 tx=0).stop 2026-02-13T01:28:51.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13f8115410 msgr2=0x7f13f811d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:51.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13f8115410 0x7f13f811d4a0 secure :-1 s=READY pgs=375 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13e0004750 tx=0x7f13e000bb80 comp rx=0 tx=0).stop 2026-02-13T01:28:51.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 shutdown_connections 2026-02-13T01:28:51.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f13d00b56d0 0x7f13d00d5b80 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.732 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f13f8122810 0x7f13f8122cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.732 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13f8115410 0x7f13f811d4a0 unknown :-1 s=CLOSED pgs=375 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.732 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 --2- 10.20.193.40:0/670028317 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f13f810f200 0x7f13f811cf60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:51.732 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 >> 10.20.193.40:0/670028317 conn(0x7f13f80ecb00 msgr2=0x7f13f810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:51.732 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 shutdown_connections 2026-02-13T01:28:51.732 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:51.730+0000 7f13fcb7c6c0 1 -- 10.20.193.40:0/670028317 wait complete. 2026-02-13T01:28:52.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:51 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/670028317' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:52.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:51 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/670028317' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:52.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:51 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/670028317' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:53.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:52 trial055 ceph-mon[27509]: pgmap v333: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:53.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:52 trial040 ceph-mon[23046]: pgmap v333: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:53.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:52 trial118 ceph-mon[27812]: pgmap v333: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:54.241 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:53 trial055 ceph-mon[27509]: pgmap v334: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:54.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:53 trial040 ceph-mon[23046]: pgmap v334: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:54.253 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:53 trial118 ceph-mon[27812]: pgmap v334: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:54.837 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:55.021 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:55.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.218+0000 7f84cffff6c0 1 -- 10.20.193.40:0/3718906629 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d0115270 msgr2=0x7f84d0175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.218+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/3718906629 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d0115270 0x7f84d0175c10 secure :-1 s=READY pgs=376 gs=3 cs=0 l=1 c_cookie=10397601374357196235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c000aa70 tx=0x7f84c002fdd0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.219+0000 7f84cffff6c0 1 -- 10.20.193.40:0/3718906629 shutdown_connections 2026-02-13T01:28:55.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.219+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/3718906629 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d0115270 0x7f84d0175c10 unknown :-1 s=CLOSED pgs=376 gs=3 cs=0 l=1 c_cookie=10397601374357196235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.219+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/3718906629 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f84d010fa50 0x7f84d0114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.219+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/3718906629 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f84d010f060 0x7f84d010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.219+0000 7f84cffff6c0 1 -- 10.20.193.40:0/3718906629 >> 10.20.193.40:0/3718906629 conn(0x7f84d00ec980 msgr2=0x7f84d010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:55.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.219+0000 7f84cffff6c0 1 -- 10.20.193.40:0/3718906629 shutdown_connections 2026-02-13T01:28:55.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.219+0000 7f84cffff6c0 1 -- 10.20.193.40:0/3718906629 wait complete. 2026-02-13T01:28:55.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.220+0000 7f84cffff6c0 1 Processor -- start 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.220+0000 7f84cffff6c0 1 -- start start 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.220+0000 7f84cffff6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f84d010f060 0x7f84d011cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.220+0000 7f84cffff6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f84d0115270 0x7f84d011d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.220+0000 7f84cffff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d0122680 0x7f84d0122b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.220+0000 7f84cffff6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84d0123090 con 0x7f84d0122680 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.220+0000 7f84cffff6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7f84d0123200 con 0x7f84d010f060 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.220+0000 7f84cffff6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7f84d01233c0 con 0x7f84d0115270 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84cf7fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d0122680 0x7f84d0122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84ceffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f84d010f060 0x7f84d011cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84ceffd6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f84d010f060 0x7f84d011cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.55:3300/0 says I am v2:10.20.193.40:58844/0 (socket says 10.20.193.40:58844) 2026-02-13T01:28:55.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84ceffd6c0 1 -- 10.20.193.40:0/2758893870 learned_addr learned my addr 10.20.193.40:0/2758893870 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84ce7fc6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f84d0115270 0x7f84d011d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84cf7fe6c0 1 -- 10.20.193.40:0/2758893870 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f84d0115270 msgr2=0x7f84d011d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84cf7fe6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f84d0115270 0x7f84d011d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84cf7fe6c0 1 -- 10.20.193.40:0/2758893870 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f84d010f060 msgr2=0x7f84d011cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84cf7fe6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f84d010f060 0x7f84d011cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84cf7fe6c0 1 -- 10.20.193.40:0/2758893870 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c000a660 con 0x7f84d0122680 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84ceffd6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f84d010f060 0x7f84d011cd80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84cf7fe6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d0122680 0x7f84d0122b20 secure :-1 s=READY pgs=377 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c00302e0 tx=0x7f84c003cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84d489e6c0 1 -- 10.20.193.40:0/2758893870 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84c0030850 con 0x7f84d0122680 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84d489e6c0 1 -- 10.20.193.40:0/2758893870 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f84c00057b0 con 0x7f84d0122680 2026-02-13T01:28:55.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84d489e6c0 1 -- 10.20.193.40:0/2758893870 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84c00089c0 con 0x7f84d0122680 2026-02-13T01:28:55.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d0062870 con 0x7f84d0122680 2026-02-13T01:28:55.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.221+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d0062ca0 con 0x7f84d0122680 2026-02-13T01:28:55.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.222+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d0110330 con 0x7f84d0122680 2026-02-13T01:28:55.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.224+0000 7f84d489e6c0 1 -- 10.20.193.40:0/2758893870 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f84c0003910 con 0x7f84d0122680 2026-02-13T01:28:55.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.226+0000 7f84d489e6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f84a40b5650 0x7f84a40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:55.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.226+0000 7f84d489e6c0 1 -- 10.20.193.40:0/2758893870 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f84c01117e0 con 0x7f84d0122680 2026-02-13T01:28:55.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.226+0000 7f84ceffd6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f84a40b5650 0x7f84a40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:55.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.226+0000 7f84d489e6c0 1 -- 10.20.193.40:0/2758893870 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f84c0111c60 con 0x7f84d0122680 2026-02-13T01:28:55.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.226+0000 7f84ceffd6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f84a40b5650 0x7f84a40d5b00 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c40095e0 tx=0x7f84c4009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:55.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.350+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f84d011ded0 con 0x7f84d0122680 2026-02-13T01:28:55.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.350+0000 7f84d489e6c0 1 -- 10.20.193.40:0/2758893870 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f84c00d4180 con 0x7f84d0122680 2026-02-13T01:28:55.351 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:55.351 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:55.352 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f84a40b5650 msgr2=0x7f84a40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.352 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f84a40b5650 0x7f84a40d5b00 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c40095e0 tx=0x7f84c4009260 comp rx=0 tx=0).stop 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d0122680 msgr2=0x7f84d0122b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d0122680 0x7f84d0122b20 secure :-1 s=READY pgs=377 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c00302e0 tx=0x7f84c003cdd0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 shutdown_connections 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7f84a40b5650 0x7f84a40d5b00 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d0122680 0x7f84d0122b20 unknown :-1 s=CLOSED pgs=377 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7f84d0115270 0x7f84d011d2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 --2- 10.20.193.40:0/2758893870 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7f84d010f060 0x7f84d011cd80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 >> 10.20.193.40:0/2758893870 conn(0x7f84d00ec980 msgr2=0x7f84d010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 shutdown_connections 2026-02-13T01:28:55.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:55.351+0000 7f84cffff6c0 1 -- 10.20.193.40:0/2758893870 wait complete. 2026-02-13T01:28:56.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:56 trial055 ceph-mon[27509]: pgmap v335: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:56.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:56 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/2758893870' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:56.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:56 trial040 ceph-mon[23046]: pgmap v335: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:56.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:56 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/2758893870' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:56.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:56 trial118 ceph-mon[27812]: pgmap v335: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:56.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:56 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/2758893870' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:58.489 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:58.541 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:58 trial040 ceph-mon[23046]: pgmap v336: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:58.674 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:28:58.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:58 trial055 ceph-mon[27509]: pgmap v336: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:58.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:58 trial118 ceph-mon[27812]: pgmap v336: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:58.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.859+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/893835168 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe61810f060 msgr2=0x7fe61810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:58.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.859+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/893835168 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe61810f060 0x7fe61810f430 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=17878429444270555377 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6080099a0 tx=0x7fe60802ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:58.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.859+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/893835168 shutdown_connections 2026-02-13T01:28:58.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.859+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/893835168 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe618115270 0x7fe618175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.859+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/893835168 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe61810fa50 0x7fe618114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.859+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/893835168 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe61810f060 0x7fe61810f430 unknown :-1 s=CLOSED pgs=378 gs=1 cs=0 l=1 c_cookie=17878429444270555377 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.859+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/893835168 >> 10.20.193.40:0/893835168 conn(0x7fe6180ec980 msgr2=0x7fe61810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:58.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.859+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/893835168 shutdown_connections 2026-02-13T01:28:58.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.859+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/893835168 wait complete. 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.860+0000 7fe61d98e6c0 1 Processor -- start 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.860+0000 7fe61d98e6c0 1 -- start start 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.860+0000 7fe61d98e6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe61810f060 0x7fe61811ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.860+0000 7fe61d98e6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe618115270 0x7fe61811d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.860+0000 7fe61d98e6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe618122700 0x7fe618122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.860+0000 7fe61d98e6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe618123110 con 0x7fe618122700 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.860+0000 7fe61d98e6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe618123280 con 0x7fe61810f060 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.860+0000 7fe61d98e6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe618123440 con 0x7fe618115270 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d18d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe618122700 0x7fe618122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:58.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d18d6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe618122700 0x7fe618122ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:34582/0 (socket says 10.20.193.40:34582) 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d18d6c0 1 -- 10.20.193.40:0/3853086265 learned_addr learned my addr 10.20.193.40:0/3853086265 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe60ffff6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe618115270 0x7fe61811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61c98c6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe61810f060 0x7fe61811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d18d6c0 1 -- 10.20.193.40:0/3853086265 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe618115270 msgr2=0x7fe61811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d18d6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe618115270 0x7fe61811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d18d6c0 1 -- 10.20.193.40:0/3853086265 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe61810f060 msgr2=0x7fe61811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d18d6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe61810f060 0x7fe61811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d18d6c0 1 -- 10.20.193.40:0/3853086265 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe608009590 con 0x7fe618122700 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe60ffff6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe618115270 0x7fe61811d340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d18d6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe618122700 0x7fe618122ba0 secure :-1 s=READY pgs=379 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe614006ea0 tx=0x7fe61400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe60dffb6c0 1 -- 10.20.193.40:0/3853086265 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe614003c40 con 0x7fe618122700 2026-02-13T01:28:58.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe60dffb6c0 1 -- 10.20.193.40:0/3853086265 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe614003da0 con 0x7fe618122700 2026-02-13T01:28:58.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe60dffb6c0 1 -- 10.20.193.40:0/3853086265 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe614008440 con 0x7fe618122700 2026-02-13T01:28:58.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6181638f0 con 0x7fe618122700 2026-02-13T01:28:58.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.861+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe618163d80 con 0x7fe618122700 2026-02-13T01:28:58.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.862+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe618110330 con 0x7fe618122700 2026-02-13T01:28:58.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.864+0000 7fe60dffb6c0 1 -- 10.20.193.40:0/3853086265 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe61400d690 con 0x7fe618122700 2026-02-13T01:28:58.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.866+0000 7fe60dffb6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe5f40b56d0 0x7fe5f40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:58.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.866+0000 7fe60dffb6c0 1 -- 10.20.193.40:0/3853086265 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fe6140e4c90 con 0x7fe618122700 2026-02-13T01:28:58.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.866+0000 7fe61c98c6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe5f40b56d0 0x7fe5f40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:58.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.866+0000 7fe60dffb6c0 1 -- 10.20.193.40:0/3853086265 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe6140e5110 con 0x7fe618122700 2026-02-13T01:28:58.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.867+0000 7fe61c98c6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe5f40b56d0 0x7fe5f40d5b80 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe608005b40 tx=0x7fe6080023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:58.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.989+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe61810f430 con 0x7fe618122700 2026-02-13T01:28:58.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.989+0000 7fe60dffb6c0 1 -- 10.20.193.40:0/3853086265 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe6140a7630 con 0x7fe618122700 2026-02-13T01:28:58.991 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:28:58.991 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:58.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.990+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe5f40b56d0 msgr2=0x7fe5f40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:58.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.990+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe5f40b56d0 0x7fe5f40d5b80 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe608005b40 tx=0x7fe6080023a0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.990+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe618122700 msgr2=0x7fe618122ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.990+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe618122700 0x7fe618122ba0 secure :-1 s=READY pgs=379 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe614006ea0 tx=0x7fe61400ce50 comp rx=0 tx=0).stop 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.991+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 shutdown_connections 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.991+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fe5f40b56d0 0x7fe5f40d5b80 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.991+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe618122700 0x7fe618122ba0 unknown :-1 s=CLOSED pgs=379 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.991+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fe618115270 0x7fe61811d340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.991+0000 7fe61d98e6c0 1 --2- 10.20.193.40:0/3853086265 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fe61810f060 0x7fe61811ce00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.991+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 >> 10.20.193.40:0/3853086265 conn(0x7fe6180ec980 msgr2=0x7fe61810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.991+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 shutdown_connections 2026-02-13T01:28:58.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:28:58.991+0000 7fe61d98e6c0 1 -- 10.20.193.40:0/3853086265 wait complete. 2026-02-13T01:28:59.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:59 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3853086265' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:59.499 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:28:59 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:28:59.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:59 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3853086265' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:59.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:28:59 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:28:59.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:59 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3853086265' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:59.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:28:59 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:29:00.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:00 trial118 ceph-mon[27812]: pgmap v337: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:00.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:00.504 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:29:00.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:29:00.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:29:00.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:29:00.505 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:00 trial118 ceph-mon[27812]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:00.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:00 trial055 ceph-mon[27509]: pgmap v337: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:00.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:00.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:29:00.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:29:00.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:29:00.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:29:00.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:00 trial055 ceph-mon[27509]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:00 trial040 ceph-mon[23046]: pgmap v337: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:29:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' 2026-02-13T01:29:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:29:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:29:00.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:00 trial040 ceph-mon[23046]: from='mgr.14190 10.20.193.40:0/3569591937' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:01.741 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:01 trial055 ceph-mon[27509]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:29:01.742 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:01 trial055 ceph-mon[27509]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:01.748 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:01 trial040 ceph-mon[23046]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:29:01.749 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:01 trial040 ceph-mon[23046]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:01.753 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:01 trial118 ceph-mon[27812]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:29:01.754 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:01 trial118 ceph-mon[27812]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:02.095 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:02.280 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:29:02.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.486+0000 7fbf277f96c0 1 -- 10.20.193.40:0/280402701 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201137a0 msgr2=0x7fbf20113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.486+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/280402701 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201137a0 0x7fbf20113b70 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=5818497569962228142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf10009970 tx=0x7fbf1002ed10 comp rx=0 tx=0).stop 2026-02-13T01:29:02.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.486+0000 7fbf277f96c0 1 -- 10.20.193.40:0/280402701 shutdown_connections 2026-02-13T01:29:02.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.486+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/280402701 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf201198f0 0x7fbf2017a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.487 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.486+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/280402701 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf20114190 0x7fbf20119140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.486+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/280402701 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201137a0 0x7fbf20113b70 unknown :-1 s=CLOSED pgs=380 gs=1 cs=0 l=1 c_cookie=5818497569962228142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.486+0000 7fbf277f96c0 1 -- 10.20.193.40:0/280402701 >> 10.20.193.40:0/280402701 conn(0x7fbf20060760 msgr2=0x7fbf20060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:02.488 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.486+0000 7fbf277f96c0 1 -- 10.20.193.40:0/280402701 shutdown_connections 2026-02-13T01:29:02.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.486+0000 7fbf277f96c0 1 -- 10.20.193.40:0/280402701 wait complete. 2026-02-13T01:29:02.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.487+0000 7fbf277f96c0 1 Processor -- start 2026-02-13T01:29:02.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.487+0000 7fbf277f96c0 1 -- start start 2026-02-13T01:29:02.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.487+0000 7fbf277f96c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf201137a0 0x7fbf20121590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:02.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.487+0000 7fbf277f96c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201198f0 0x7fbf20121ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:02.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.487+0000 7fbf277f96c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf20126e90 0x7fbf20127330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:02.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.487+0000 7fbf277f96c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbf201278a0 con 0x7fbf201198f0 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.487+0000 7fbf277f96c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20127a10 con 0x7fbf20126e90 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.487+0000 7fbf277f96c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20127bd0 con 0x7fbf201137a0 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf24d696c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201198f0 0x7fbf20121ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf24d696c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201198f0 0x7fbf20121ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:38324/0 (socket says 10.20.193.40:38324) 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf24d696c0 1 -- 10.20.193.40:0/3029226216 learned_addr learned my addr 10.20.193.40:0/3029226216 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf2556a6c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf201137a0 0x7fbf20121590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf25d6b6c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf20126e90 0x7fbf20127330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf24d696c0 1 -- 10.20.193.40:0/3029226216 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf201137a0 msgr2=0x7fbf20121590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf24d696c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf201137a0 0x7fbf20121590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf24d696c0 1 -- 10.20.193.40:0/3029226216 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf20126e90 msgr2=0x7fbf20127330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf24d696c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf20126e90 0x7fbf20127330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf24d696c0 1 -- 10.20.193.40:0/3029226216 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf10009590 con 0x7fbf201198f0 2026-02-13T01:29:02.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf24d696c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201198f0 0x7fbf20121ad0 secure :-1 s=READY pgs=381 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1400b710 tx=0x7fbf1400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:02.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf0e7fc6c0 1 -- 10.20.193.40:0/3029226216 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf14004250 con 0x7fbf201198f0 2026-02-13T01:29:02.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf20168080 con 0x7fbf201198f0 2026-02-13T01:29:02.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf0e7fc6c0 1 -- 10.20.193.40:0/3029226216 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbf14009070 con 0x7fbf201198f0 2026-02-13T01:29:02.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf0e7fc6c0 1 -- 10.20.193.40:0/3029226216 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf140071c0 con 0x7fbf201198f0 2026-02-13T01:29:02.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.488+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf20168560 con 0x7fbf201198f0 2026-02-13T01:29:02.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.489+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf201149e0 con 0x7fbf201198f0 2026-02-13T01:29:02.493 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.491+0000 7fbf0e7fc6c0 1 -- 10.20.193.40:0/3029226216 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fbf140043b0 con 0x7fbf201198f0 2026-02-13T01:29:02.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.493+0000 7fbf0e7fc6c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbefc0b56d0 0x7fbefc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:02.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.493+0000 7fbf0e7fc6c0 1 -- 10.20.193.40:0/3029226216 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fbf140e3c20 con 0x7fbf201198f0 2026-02-13T01:29:02.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.493+0000 7fbf2556a6c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbefc0b56d0 0x7fbefc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:02.494 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.493+0000 7fbf0e7fc6c0 1 -- 10.20.193.40:0/3029226216 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbf1411c680 con 0x7fbf201198f0 2026-02-13T01:29:02.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.493+0000 7fbf2556a6c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbefc0b56d0 0x7fbefc0d5b80 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf100023e0 tx=0x7fbf10005c60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:02.619 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.618+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbf20113b70 con 0x7fbf201198f0 2026-02-13T01:29:02.620 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.618+0000 7fbf0e7fc6c0 1 -- 10.20.193.40:0/3029226216 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbf140a65c0 con 0x7fbf201198f0 2026-02-13T01:29:02.620 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:29:02.620 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:02.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbefc0b56d0 msgr2=0x7fbefc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbefc0b56d0 0x7fbefc0d5b80 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf100023e0 tx=0x7fbf10005c60 comp rx=0 tx=0).stop 2026-02-13T01:29:02.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201198f0 msgr2=0x7fbf20121ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.621 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201198f0 0x7fbf20121ad0 secure :-1 s=READY pgs=381 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1400b710 tx=0x7fbf1400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 shutdown_connections 2026-02-13T01:29:02.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fbefc0b56d0 0x7fbefc0d5b80 unknown :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fbf20126e90 0x7fbf20127330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf201198f0 0x7fbf20121ad0 unknown :-1 s=CLOSED pgs=381 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 --2- 10.20.193.40:0/3029226216 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fbf201137a0 0x7fbf20121590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 >> 10.20.193.40:0/3029226216 conn(0x7fbf20060760 msgr2=0x7fbf20115b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:02.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 shutdown_connections 2026-02-13T01:29:02.622 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:02.619+0000 7fbf277f96c0 1 -- 10.20.193.40:0/3029226216 wait complete. 2026-02-13T01:29:03.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:03 trial055 ceph-mon[27509]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:29:03.992 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:03 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/3029226216' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:03.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:03 trial040 ceph-mon[23046]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:29:03.999 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:03 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/3029226216' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:04.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:03 trial118 ceph-mon[27812]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:29:04.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:03 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/3029226216' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:05.757 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:05.943 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:29:05.986 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:05 trial040 ceph-mon[23046]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:05.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:05 trial055 ceph-mon[27509]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:06.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:05 trial118 ceph-mon[27812]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:06.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.151+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/542498119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 msgr2=0x7fb52810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:06.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.151+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/542498119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 0x7fb52810f5d0 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=11079849857911958064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5140099a0 tx=0x7fb51402ed00 comp rx=0 tx=0).stop 2026-02-13T01:29:06.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.151+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/542498119 shutdown_connections 2026-02-13T01:29:06.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.151+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/542498119 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb528115410 0x7fb528175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.151+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/542498119 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb52810fbf0 0x7fb528114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.151+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/542498119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 0x7fb52810f5d0 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=11079849857911958064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.151+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/542498119 >> 10.20.193.40:0/542498119 conn(0x7fb5280ecb00 msgr2=0x7fb52810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:06.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.151+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/542498119 shutdown_connections 2026-02-13T01:29:06.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.151+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/542498119 wait complete. 2026-02-13T01:29:06.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb52db4b6c0 1 Processor -- start 2026-02-13T01:29:06.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb52db4b6c0 1 -- start start 2026-02-13T01:29:06.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb52db4b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 0x7fb52811cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:06.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb52db4b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb528115410 0x7fb52811d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:06.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb52db4b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb5281228b0 0x7fb528122d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:06.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb52db4b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb5281232c0 con 0x7fb52810f200 2026-02-13T01:29:06.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb52db4b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb528123430 con 0x7fb5281228b0 2026-02-13T01:29:06.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb52db4b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb5281235f0 con 0x7fb528115410 2026-02-13T01:29:06.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb5277fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 0x7fb52811cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:06.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb5277fe6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 0x7fb52811cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:38342/0 (socket says 10.20.193.40:38342) 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb5277fe6c0 1 -- 10.20.193.40:0/786028617 learned_addr learned my addr 10.20.193.40:0/786028617 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb527fff6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb5281228b0 0x7fb528122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb526ffd6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb528115410 0x7fb52811d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb5277fe6c0 1 -- 10.20.193.40:0/786028617 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb528115410 msgr2=0x7fb52811d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb5277fe6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb528115410 0x7fb52811d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb5277fe6c0 1 -- 10.20.193.40:0/786028617 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb5281228b0 msgr2=0x7fb528122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.152+0000 7fb5277fe6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb5281228b0 0x7fb528122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.153+0000 7fb5277fe6c0 1 -- 10.20.193.40:0/786028617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb514009590 con 0x7fb52810f200 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.153+0000 7fb5277fe6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 0x7fb52811cfb0 secure :-1 s=READY pgs=383 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb51402f210 tx=0x7fb51402f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:06.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.153+0000 7fb524ff96c0 1 -- 10.20.193.40:0/786028617 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb514005e90 con 0x7fb52810f200 2026-02-13T01:29:06.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.153+0000 7fb524ff96c0 1 -- 10.20.193.40:0/786028617 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb5140046b0 con 0x7fb52810f200 2026-02-13T01:29:06.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.153+0000 7fb524ff96c0 1 -- 10.20.193.40:0/786028617 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5140073f0 con 0x7fb52810f200 2026-02-13T01:29:06.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.153+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb528163a40 con 0x7fb52810f200 2026-02-13T01:29:06.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.153+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb528163ec0 con 0x7fb52810f200 2026-02-13T01:29:06.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.153+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5281104d0 con 0x7fb52810f200 2026-02-13T01:29:06.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.156+0000 7fb524ff96c0 1 -- 10.20.193.40:0/786028617 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb514031150 con 0x7fb52810f200 2026-02-13T01:29:06.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.157+0000 7fb524ff96c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4fc0b56d0 0x7fb4fc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:06.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.157+0000 7fb524ff96c0 1 -- 10.20.193.40:0/786028617 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fb514107c00 con 0x7fb52810f200 2026-02-13T01:29:06.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.158+0000 7fb524ff96c0 1 -- 10.20.193.40:0/786028617 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb514140660 con 0x7fb52810f200 2026-02-13T01:29:06.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.158+0000 7fb526ffd6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4fc0b56d0 0x7fb4fc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:06.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.158+0000 7fb526ffd6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4fc0b56d0 0x7fb4fc0d5b80 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb528123940 tx=0x7fb518009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:06.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.282+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb52811e100 con 0x7fb52810f200 2026-02-13T01:29:06.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.282+0000 7fb524ff96c0 1 -- 10.20.193.40:0/786028617 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb5140ca5a0 con 0x7fb52810f200 2026-02-13T01:29:06.284 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:29:06.284 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:06.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4fc0b56d0 msgr2=0x7fb4fc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:06.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4fc0b56d0 0x7fb4fc0d5b80 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb528123940 tx=0x7fb518009260 comp rx=0 tx=0).stop 2026-02-13T01:29:06.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 msgr2=0x7fb52811cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:06.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 0x7fb52811cfb0 secure :-1 s=READY pgs=383 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb51402f210 tx=0x7fb51402f810 comp rx=0 tx=0).stop 2026-02-13T01:29:06.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 shutdown_connections 2026-02-13T01:29:06.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4fc0b56d0 0x7fb4fc0d5b80 unknown :-1 s=CLOSED pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb5281228b0 0x7fb528122d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb528115410 0x7fb52811d4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 --2- 10.20.193.40:0/786028617 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb52810f200 0x7fb52811cfb0 unknown :-1 s=CLOSED pgs=383 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 >> 10.20.193.40:0/786028617 conn(0x7fb5280ecb00 msgr2=0x7fb52810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:06.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 shutdown_connections 2026-02-13T01:29:06.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:06.283+0000 7fb52db4b6c0 1 -- 10.20.193.40:0/786028617 wait complete. 2026-02-13T01:29:06.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:06 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/786028617' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:06.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:06 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/786028617' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:07.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:06 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/786028617' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:07.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:07 trial055 ceph-mon[27509]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:07.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:07 trial040 ceph-mon[23046]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:08.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:07 trial118 ceph-mon[27812]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:09.393 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:09.580 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:29:09.709 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:09 trial040 ceph-mon[23046]: pgmap v343: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-13T01:29:09.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.771+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/1707738589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 msgr2=0x7fb4e810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.771+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/1707738589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 0x7fb4e810f430 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=10573441842515269355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d40099a0 tx=0x7fb4d402ed00 comp rx=0 tx=0).stop 2026-02-13T01:29:09.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.771+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/1707738589 shutdown_connections 2026-02-13T01:29:09.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.771+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/1707738589 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb4e8115270 0x7fb4e8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.771+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/1707738589 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb4e810fa50 0x7fb4e8114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.771+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/1707738589 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 0x7fb4e810f430 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=10573441842515269355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.771+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/1707738589 >> 10.20.193.40:0/1707738589 conn(0x7fb4e80ec980 msgr2=0x7fb4e810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:09.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.771+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/1707738589 shutdown_connections 2026-02-13T01:29:09.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.771+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/1707738589 wait complete. 2026-02-13T01:29:09.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4ed04b6c0 1 Processor -- start 2026-02-13T01:29:09.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4ed04b6c0 1 -- start start 2026-02-13T01:29:09.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4ed04b6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 0x7fb4e811ce20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:09.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4ed04b6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb4e8115270 0x7fb4e811d360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4ed04b6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb4e8122720 0x7fb4e8122bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4ed04b6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e8123130 con 0x7fb4e810f060 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4ed04b6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e81232a0 con 0x7fb4e8122720 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4ed04b6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e8123460 con 0x7fb4e8115270 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4e7fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 0x7fb4e811ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4e77fe6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb4e8115270 0x7fb4e811d360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.772+0000 7fb4e7fff6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 0x7fb4e811ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:38366/0 (socket says 10.20.193.40:38366) 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e7fff6c0 1 -- 10.20.193.40:0/451365009 learned_addr learned my addr 10.20.193.40:0/451365009 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4ec84a6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb4e8122720 0x7fb4e8122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e7fff6c0 1 -- 10.20.193.40:0/451365009 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb4e8115270 msgr2=0x7fb4e811d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e7fff6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb4e8115270 0x7fb4e811d360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e7fff6c0 1 -- 10.20.193.40:0/451365009 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb4e8122720 msgr2=0x7fb4e8122bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e7fff6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb4e8122720 0x7fb4e8122bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e7fff6c0 1 -- 10.20.193.40:0/451365009 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d4009590 con 0x7fb4e810f060 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e7fff6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 0x7fb4e811ce20 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d402f210 tx=0x7fb4d402f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e57fa6c0 1 -- 10.20.193.40:0/451365009 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4d40046b0 con 0x7fb4e810f060 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e57fa6c0 1 -- 10.20.193.40:0/451365009 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb4d4002be0 con 0x7fb4e810f060 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4e57fa6c0 1 -- 10.20.193.40:0/451365009 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4d40073f0 con 0x7fb4e810f060 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e81638b0 con 0x7fb4e810f060 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.773+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e8163ce0 con 0x7fb4e810f060 2026-02-13T01:29:09.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.774+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e8110330 con 0x7fb4e810f060 2026-02-13T01:29:09.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.776+0000 7fb4e57fa6c0 1 -- 10.20.193.40:0/451365009 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb4d40026b0 con 0x7fb4e810f060 2026-02-13T01:29:09.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.778+0000 7fb4e57fa6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4bc0b56d0 0x7fb4bc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:09.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.778+0000 7fb4e57fa6c0 1 -- 10.20.193.40:0/451365009 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fb4d4107d70 con 0x7fb4e810f060 2026-02-13T01:29:09.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.778+0000 7fb4e77fe6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4bc0b56d0 0x7fb4bc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:09.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.778+0000 7fb4e57fa6c0 1 -- 10.20.193.40:0/451365009 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb4d41081f0 con 0x7fb4e810f060 2026-02-13T01:29:09.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.778+0000 7fb4e77fe6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4bc0b56d0 0x7fb4bc0d5b80 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4e81237b0 tx=0x7fb4d8009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:09.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.901+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb4e810f430 con 0x7fb4e810f060 2026-02-13T01:29:09.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.901+0000 7fb4e57fa6c0 1 -- 10.20.193.40:0/451365009 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb4d40ca710 con 0x7fb4e810f060 2026-02-13T01:29:09.903 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:29:09.903 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:09.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4bc0b56d0 msgr2=0x7fb4bc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4bc0b56d0 0x7fb4bc0d5b80 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4e81237b0 tx=0x7fb4d8009260 comp rx=0 tx=0).stop 2026-02-13T01:29:09.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 msgr2=0x7fb4e811ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 0x7fb4e811ce20 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d402f210 tx=0x7fb4d402f810 comp rx=0 tx=0).stop 2026-02-13T01:29:09.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 shutdown_connections 2026-02-13T01:29:09.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fb4bc0b56d0 0x7fb4bc0d5b80 unknown :-1 s=CLOSED pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fb4e8122720 0x7fb4e8122bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fb4e8115270 0x7fb4e811d360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 --2- 10.20.193.40:0/451365009 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4e810f060 0x7fb4e811ce20 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 >> 10.20.193.40:0/451365009 conn(0x7fb4e80ec980 msgr2=0x7fb4e810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:09.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.902+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 shutdown_connections 2026-02-13T01:29:09.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:09.903+0000 7fb4ed04b6c0 1 -- 10.20.193.40:0/451365009 wait complete. 2026-02-13T01:29:09.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:09 trial055 ceph-mon[27509]: pgmap v343: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-13T01:29:10.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:09 trial118 ceph-mon[27812]: pgmap v343: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-13T01:29:10.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:10 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/451365009' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:10.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:10 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/451365009' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:11.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:10 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/451365009' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:11.892 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:11 trial055 ceph-mon[27509]: pgmap v344: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 6 op/s 2026-02-13T01:29:11.998 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:11 trial040 ceph-mon[23046]: pgmap v344: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 6 op/s 2026-02-13T01:29:12.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:11 trial118 ceph-mon[27812]: pgmap v344: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 6 op/s 2026-02-13T01:29:13.008 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:13.193 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:29:13.387 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.386+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1192974044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e010b650 msgr2=0x7fd4e0154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:13.387 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.386+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1192974044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e010b650 0x7fd4e0154ce0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=8581664343881911346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4d4009970 tx=0x7fd4d402ed10 comp rx=0 tx=0).stop 2026-02-13T01:29:13.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.387+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1192974044 shutdown_connections 2026-02-13T01:29:13.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.387+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1192974044 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4e0155380 0x7fd4e0175810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.387+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1192974044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e010b650 0x7fd4e0154ce0 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=8581664343881911346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.387+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1192974044 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4e010ad40 0x7fd4e010b110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.387+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1192974044 >> 10.20.193.40:0/1192974044 conn(0x7fd4e00638a0 msgr2=0x7fd4e0109040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.387+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1192974044 shutdown_connections 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.387+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1192974044 wait complete. 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.387+0000 7fd4e70ec6c0 1 Processor -- start 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.387+0000 7fd4e70ec6c0 1 -- start start 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e70ec6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4e010ad40 0x7fd4e015f070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e70ec6c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4e010b650 0x7fd4e015f5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e70ec6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e0155380 0x7fd4e0164920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e70ec6c0 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0164f70 con 0x7fd4e0155380 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e70ec6c0 1 -- --> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01650e0 con 0x7fd4e010b650 2026-02-13T01:29:13.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e70ec6c0 1 -- --> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01652a0 con 0x7fd4e010ad40 2026-02-13T01:29:13.391 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e68eb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e0155380 0x7fd4e0164920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:13.391 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e60ea6c0 1 --2- >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4e010ad40 0x7fd4e015f070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:13.391 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e68eb6c0 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e0155380 0x7fd4e0164920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:58146/0 (socket says 10.20.193.40:58146) 2026-02-13T01:29:13.391 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e68eb6c0 1 -- 10.20.193.40:0/1577960357 learned_addr learned my addr 10.20.193.40:0/1577960357 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-13T01:29:13.391 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e58e96c0 1 --2- >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4e010b650 0x7fd4e015f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:13.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e68eb6c0 1 -- 10.20.193.40:0/1577960357 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4e010ad40 msgr2=0x7fd4e015f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:13.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e68eb6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4e010ad40 0x7fd4e015f070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e68eb6c0 1 -- 10.20.193.40:0/1577960357 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4e010b650 msgr2=0x7fd4e015f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:13.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e68eb6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4e010b650 0x7fd4e015f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e68eb6c0 1 -- 10.20.193.40:0/1577960357 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d4009590 con 0x7fd4e0155380 2026-02-13T01:29:13.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.388+0000 7fd4e68eb6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e0155380 0x7fd4e0164920 secure :-1 s=READY pgs=387 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4dc006ea0 tx=0x7fd4dc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:13.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.389+0000 7fd4c77fe6c0 1 -- 10.20.193.40:0/1577960357 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4dc003a30 con 0x7fd4e0155380 2026-02-13T01:29:13.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.389+0000 7fd4c77fe6c0 1 -- 10.20.193.40:0/1577960357 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd4dc005560 con 0x7fd4e0155380 2026-02-13T01:29:13.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.389+0000 7fd4c77fe6c0 1 -- 10.20.193.40:0/1577960357 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4dc0082a0 con 0x7fd4e0155380 2026-02-13T01:29:13.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.389+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e0165580 con 0x7fd4e0155380 2026-02-13T01:29:13.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.389+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e0152e70 con 0x7fd4e0155380 2026-02-13T01:29:13.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.389+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e01657a0 con 0x7fd4e0155380 2026-02-13T01:29:13.394 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.392+0000 7fd4c77fe6c0 1 -- 10.20.193.40:0/1577960357 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fd4dc00d4d0 con 0x7fd4e0155380 2026-02-13T01:29:13.394 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.393+0000 7fd4c77fe6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4bc0b56d0 0x7fd4bc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:13.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.393+0000 7fd4c77fe6c0 1 -- 10.20.193.40:0/1577960357 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fd4dc0e4b30 con 0x7fd4e0155380 2026-02-13T01:29:13.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.393+0000 7fd4e60ea6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4bc0b56d0 0x7fd4bc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:13.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.393+0000 7fd4c77fe6c0 1 -- 10.20.193.40:0/1577960357 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd4dc11d5e0 con 0x7fd4e0155380 2026-02-13T01:29:13.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.394+0000 7fd4e60ea6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4bc0b56d0 0x7fd4bc0d5b80 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4d0004750 tx=0x7fd4d0009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:13.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.518+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd4e0160170 con 0x7fd4e0155380 2026-02-13T01:29:13.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.518+0000 7fd4c77fe6c0 1 -- 10.20.193.40:0/1577960357 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd4dc0a74d0 con 0x7fd4e0155380 2026-02-13T01:29:13.520 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-13T01:29:13.520 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:13.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4bc0b56d0 msgr2=0x7fd4bc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:13.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4bc0b56d0 0x7fd4bc0d5b80 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4d0004750 tx=0x7fd4d0009260 comp rx=0 tx=0).stop 2026-02-13T01:29:13.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e0155380 msgr2=0x7fd4e0164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:13.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e0155380 0x7fd4e0164920 secure :-1 s=READY pgs=387 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4dc006ea0 tx=0x7fd4dc00cca0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 shutdown_connections 2026-02-13T01:29:13.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:6800/1598245266,v1:10.20.193.40:6801/1598245266] conn(0x7fd4bc0b56d0 0x7fd4bc0d5b80 unknown :-1 s=CLOSED pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd4e0155380 0x7fd4e0164920 unknown :-1 s=CLOSED pgs=387 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.55:3300/0,v1:10.20.193.55:6789/0] conn(0x7fd4e010b650 0x7fd4e015f5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 --2- 10.20.193.40:0/1577960357 >> [v2:10.20.193.118:3300/0,v1:10.20.193.118:6789/0] conn(0x7fd4e010ad40 0x7fd4e015f070 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:13.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 >> 10.20.193.40:0/1577960357 conn(0x7fd4e00638a0 msgr2=0x7fd4e015af20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:13.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 shutdown_connections 2026-02-13T01:29:13.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-13T01:29:13.519+0000 7fd4e70ec6c0 1 -- 10.20.193.40:0/1577960357 wait complete. 2026-02-13T01:29:13.623 INFO:tasks.cephadm:Teardown begin 2026-02-13T01:29:13.623 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T01:29:13.628 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:29:13.686 DEBUG:teuthology.orchestra.run.trial055:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:29:13.714 DEBUG:teuthology.orchestra.run.trial118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:29:13.742 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-13T01:29:13.743 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-13T01:29:13.924 INFO:teuthology.orchestra.run.trial040.stderr:Inferring config /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/mon.a/config 2026-02-13T01:29:13.959 INFO:teuthology.orchestra.run.trial040.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-13T01:29:13.959 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:13 trial040 ceph-mon[23046]: pgmap v345: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:13.960 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:13 trial040 ceph-mon[23046]: from='client.? 10.20.193.40:0/1577960357' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:13.985 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-13T01:29:13.986 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-13T01:29:13.986 DEBUG:teuthology.orchestra.run.trial040:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:29:13.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:13 trial055 ceph-mon[27509]: pgmap v345: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:13.991 INFO:journalctl@ceph.mon.b.trial055.stdout:Feb 13 01:29:13 trial055 ceph-mon[27509]: from='client.? 10.20.193.40:0/1577960357' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:14.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:13 trial118 ceph-mon[27812]: pgmap v345: 97 pgs: 97 active+clean; 649 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:14.003 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:13 trial118 ceph-mon[27812]: from='client.? 10.20.193.40:0/1577960357' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:14.026 DEBUG:teuthology.orchestra.run.trial055:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:29:14.042 DEBUG:teuthology.orchestra.run.trial118:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:29:14.059 INFO:tasks.cephadm:Stopping all daemons... 2026-02-13T01:29:14.059 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-13T01:29:14.059 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.a 2026-02-13T01:29:14.248 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:14 trial040 systemd[1]: Stopping Ceph mon.a for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:14.504 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:14 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a[23042]: 2026-02-13T01:29:14.247+0000 7f29cb15a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:29:14.504 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:14 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a[23042]: 2026-02-13T01:29:14.247+0000 7f29cb15a6c0 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-13T01:29:14.505 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:14 trial040 podman[73872]: 2026-02-13 01:29:14.319019167 +0000 UTC m=+0.094903099 container stop 08dc632eeb58d2e95593624138b047c94fc0cdc5ab9663a38102452a3a7ba25d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, version=10, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10) 2026-02-13T01:29:14.505 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:14 trial040 podman[73872]: 2026-02-13 01:29:14.347162601 +0000 UTC m=+0.123046533 container died 08dc632eeb58d2e95593624138b047c94fc0cdc5ab9663a38102452a3a7ba25d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, name=rockylinux, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:29:14.505 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:14 trial040 podman[73872]: 2026-02-13 01:29:14.405701041 +0000 UTC m=+0.181584974 container remove 08dc632eeb58d2e95593624138b047c94fc0cdc5ab9663a38102452a3a7ba25d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image) 2026-02-13T01:29:14.505 INFO:journalctl@ceph.mon.a.trial040.stdout:Feb 13 01:29:14 trial040 bash[73872]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-a 2026-02-13T01:29:14.514 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.a.service' 2026-02-13T01:29:14.588 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:14.588 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-13T01:29:14.589 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-13T01:29:14.589 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.b 2026-02-13T01:29:14.795 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.b.service' 2026-02-13T01:29:14.833 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:14.833 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-13T01:29:14.833 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-13T01:29:14.833 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.c 2026-02-13T01:29:15.173 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:14 trial118 systemd[1]: Stopping Ceph mon.c for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:15.173 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:14 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-c[27805]: 2026-02-13T01:29:14.938+0000 7efd1b94e6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:29:15.174 INFO:journalctl@ceph.mon.c.trial118.stdout:Feb 13 01:29:14 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mon-c[27805]: 2026-02-13T01:29:14.938+0000 7efd1b94e6c0 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-13T01:29:15.263 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mon.c.service' 2026-02-13T01:29:15.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:15.302 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-13T01:29:15.302 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-13T01:29:15.303 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.x 2026-02-13T01:29:15.610 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:29:15 trial040 systemd[1]: Stopping Ceph mgr.x for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:15.611 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:29:15 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:29:15.486+0000 7f30616d66c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:29:15.611 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:29:15 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x[23267]: 2026-02-13T01:29:15.486+0000 7f30616d66c0 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-13T01:29:15.611 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:29:15 trial040 podman[74005]: 2026-02-13 01:29:15.528339225 +0000 UTC m=+0.064719315 container died ad22f5a1eb3d54e940ce4a7f94608ab6c8250d2efea7a897d1e2b70c74a3611e (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.version=10, ceph=True, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image) 2026-02-13T01:29:15.611 INFO:journalctl@ceph.mgr.x.trial040.stdout:Feb 13 01:29:15 trial040 podman[74005]: 2026-02-13 01:29:15.609881862 +0000 UTC m=+0.146261942 container remove ad22f5a1eb3d54e940ce4a7f94608ab6c8250d2efea7a897d1e2b70c74a3611e (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mgr-x, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10) 2026-02-13T01:29:15.718 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.x.service' 2026-02-13T01:29:15.789 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:15.790 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-13T01:29:15.790 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-13T01:29:15.790 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.y 2026-02-13T01:29:16.009 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.y.service' 2026-02-13T01:29:16.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:16.043 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-13T01:29:16.043 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-13T01:29:16.043 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.z 2026-02-13T01:29:16.250 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mgr.z.service' 2026-02-13T01:29:16.285 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:16.285 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-13T01:29:16.285 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-13T01:29:16.285 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.0 2026-02-13T01:29:16.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:16 trial040 systemd[1]: Stopping Ceph osd.0 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:16.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:16 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0[35887]: 2026-02-13T01:29:16.463+0000 7fbb931786c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:29:16.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:16 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0[35887]: 2026-02-13T01:29:16.463+0000 7fbb931786c0 -1 osd.0 76 *** Got signal Terminated *** 2026-02-13T01:29:16.749 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:16 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0[35887]: 2026-02-13T01:29:16.463+0000 7fbb931786c0 -1 osd.0 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:29:21.884 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:21 trial040 podman[74133]: 2026-02-13 01:29:21.590549507 +0000 UTC m=+5.148088886 container died 493995f503c079498151cd980db0aa82107f9606346b9a773926c698940c3269 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , ceph=True, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10) 2026-02-13T01:29:21.885 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:21 trial040 podman[74133]: 2026-02-13 01:29:21.6497078 +0000 UTC m=+5.207247170 container remove 493995f503c079498151cd980db0aa82107f9606346b9a773926c698940c3269 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7) 2026-02-13T01:29:21.885 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:21 trial040 bash[74133]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0 2026-02-13T01:29:22.140 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:21 trial040 podman[74233]: 2026-02-13 01:29:21.883838581 +0000 UTC m=+0.026250779 container create c421bc6665c5c756e89d5a6404b3d7c53e27def67ee6012285743e6a1d9bd78d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.version=10, version=10, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:29:22.140 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:21 trial040 podman[74233]: 2026-02-13 01:29:21.932082076 +0000 UTC m=+0.074494284 container init c421bc6665c5c756e89d5a6404b3d7c53e27def67ee6012285743e6a1d9bd78d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T01:29:22.140 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:21 trial040 podman[74233]: 2026-02-13 01:29:21.937677671 +0000 UTC m=+0.080089879 container start c421bc6665c5c756e89d5a6404b3d7c53e27def67ee6012285743e6a1d9bd78d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, version=10, license=BSD-3-Clause) 2026-02-13T01:29:22.140 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:21 trial040 podman[74233]: 2026-02-13 01:29:21.938525637 +0000 UTC m=+0.080937845 container attach c421bc6665c5c756e89d5a6404b3d7c53e27def67ee6012285743e6a1d9bd78d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0-deactivate, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , ceph=True, version=10) 2026-02-13T01:29:22.140 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:21 trial040 podman[74233]: 2026-02-13 01:29:21.874584809 +0000 UTC m=+0.016997017 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:29:22.140 INFO:journalctl@ceph.osd.0.trial040.stdout:Feb 13 01:29:22 trial040 podman[74233]: 2026-02-13 01:29:22.126119383 +0000 UTC m=+0.268531601 container died c421bc6665c5c756e89d5a6404b3d7c53e27def67ee6012285743e6a1d9bd78d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-0-deactivate, name=rockylinux, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, version=10, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T01:29:22.210 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.0.service' 2026-02-13T01:29:22.282 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:22.283 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-13T01:29:22.283 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-13T01:29:22.283 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.1 2026-02-13T01:29:22.741 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:22 trial055 systemd[1]: Stopping Ceph osd.1 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:22.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:22 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1[33337]: 2026-02-13T01:29:22.393+0000 7f9ac72f86c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:29:22.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:22 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1[33337]: 2026-02-13T01:29:22.393+0000 7f9ac72f86c0 -1 osd.1 76 *** Got signal Terminated *** 2026-02-13T01:29:22.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:22 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1[33337]: 2026-02-13T01:29:22.393+0000 7f9ac72f86c0 -1 osd.1 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:29:27.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:27 trial055 podman[59460]: 2026-02-13 01:29:27.452663347 +0000 UTC m=+5.072350713 container died ffb02119841f88c91e0f0b99cf9a753807228730ee4beb8419b26f3350791ced (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, name=rockylinux) 2026-02-13T01:29:27.742 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:27 trial055 podman[59460]: 2026-02-13 01:29:27.461750413 +0000 UTC m=+5.081437779 container remove ffb02119841f88c91e0f0b99cf9a753807228730ee4beb8419b26f3350791ced (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, ceph=True, OSD_FLAVOR=default, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10) 2026-02-13T01:29:27.743 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:27 trial055 bash[59460]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1 2026-02-13T01:29:27.743 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:27 trial055 podman[59593]: 2026-02-13 01:29:27.608403091 +0000 UTC m=+0.016135424 container create b5ea79c7a4ff8d4fab83dc1852f3e30f2d7b23e0ea1910688d667e5301032416 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, name=rockylinux, version=10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:29:27.743 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:27 trial055 podman[59593]: 2026-02-13 01:29:27.643748708 +0000 UTC m=+0.051481041 container init b5ea79c7a4ff8d4fab83dc1852f3e30f2d7b23e0ea1910688d667e5301032416 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, summary=Rocky Linux Base image, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10) 2026-02-13T01:29:27.743 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:27 trial055 podman[59593]: 2026-02-13 01:29:27.646200914 +0000 UTC m=+0.053933247 container start b5ea79c7a4ff8d4fab83dc1852f3e30f2d7b23e0ea1910688d667e5301032416 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, summary=Rocky Linux Base image, version=10, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:29:27.743 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:27 trial055 podman[59593]: 2026-02-13 01:29:27.646611696 +0000 UTC m=+0.054344019 container attach b5ea79c7a4ff8d4fab83dc1852f3e30f2d7b23e0ea1910688d667e5301032416 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.version=10, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, name=rockylinux) 2026-02-13T01:29:27.743 INFO:journalctl@ceph.osd.1.trial055.stdout:Feb 13 01:29:27 trial055 podman[59593]: 2026-02-13 01:29:27.601645764 +0000 UTC m=+0.009378097 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:29:27.813 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.1.service' 2026-02-13T01:29:27.850 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:27.850 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-13T01:29:27.850 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-13T01:29:27.851 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.2 2026-02-13T01:29:28.254 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:27 trial118 systemd[1]: Stopping Ceph osd.2 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:28.254 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:27 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2[33963]: 2026-02-13T01:29:27.943+0000 7f29c776a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:29:28.254 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:27 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2[33963]: 2026-02-13T01:29:27.943+0000 7f29c776a6c0 -1 osd.2 76 *** Got signal Terminated *** 2026-02-13T01:29:28.254 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:27 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2[33963]: 2026-02-13T01:29:27.943+0000 7f29c776a6c0 -1 osd.2 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:29:33.254 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:33 trial118 podman[62263]: 2026-02-13 01:29:33.002276189 +0000 UTC m=+5.071672913 container died 7de98bc766cab45947fb2d806e900ea09dbfd433a6b81bd8ea5c337314a596ea (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:29:33.254 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:33 trial118 podman[62263]: 2026-02-13 01:29:33.010998248 +0000 UTC m=+5.080394961 container remove 7de98bc766cab45947fb2d806e900ea09dbfd433a6b81bd8ea5c337314a596ea (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, name=rockylinux, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:29:33.254 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:33 trial118 bash[62263]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2 2026-02-13T01:29:33.255 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:33 trial118 podman[62396]: 2026-02-13 01:29:33.140166316 +0000 UTC m=+0.015836027 container create 8f02e071bb832b142fe03a52900b6a407721426a67ea85bd59e47bf5ef33e2ba (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, io.buildah.version=1.33.7, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:29:33.255 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:33 trial118 podman[62396]: 2026-02-13 01:29:33.168875819 +0000 UTC m=+0.044545530 container init 8f02e071bb832b142fe03a52900b6a407721426a67ea85bd59e47bf5ef33e2ba (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:29:33.255 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:33 trial118 podman[62396]: 2026-02-13 01:29:33.171817859 +0000 UTC m=+0.047487581 container start 8f02e071bb832b142fe03a52900b6a407721426a67ea85bd59e47bf5ef33e2ba (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, ceph=True, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:29:33.255 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:33 trial118 podman[62396]: 2026-02-13 01:29:33.172254171 +0000 UTC m=+0.047923902 container attach 8f02e071bb832b142fe03a52900b6a407721426a67ea85bd59e47bf5ef33e2ba (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, OSD_FLAVOR=default, version=10) 2026-02-13T01:29:33.255 INFO:journalctl@ceph.osd.2.trial118.stdout:Feb 13 01:29:33 trial118 podman[62396]: 2026-02-13 01:29:33.134030016 +0000 UTC m=+0.009699747 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:29:33.340 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.2.service' 2026-02-13T01:29:33.378 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:33.379 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-13T01:29:33.379 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-13T01:29:33.379 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.3 2026-02-13T01:29:33.749 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:33 trial040 systemd[1]: Stopping Ceph osd.3 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:33.749 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:33 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3[41498]: 2026-02-13T01:29:33.567+0000 7f38c37ec6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:29:33.749 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:33 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3[41498]: 2026-02-13T01:29:33.567+0000 7f38c37ec6c0 -1 osd.3 76 *** Got signal Terminated *** 2026-02-13T01:29:33.749 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:33 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3[41498]: 2026-02-13T01:29:33.567+0000 7f38c37ec6c0 -1 osd.3 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:29:38.962 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:38 trial040 podman[74349]: 2026-02-13 01:29:38.662898223 +0000 UTC m=+5.119413222 container died 3490be08e9df68c78995d6773bd7921266a9fdd9f995c5614c132d69e1434d4e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause) 2026-02-13T01:29:38.962 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:38 trial040 podman[74349]: 2026-02-13 01:29:38.72111155 +0000 UTC m=+5.177626549 container remove 3490be08e9df68c78995d6773bd7921266a9fdd9f995c5614c132d69e1434d4e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux) 2026-02-13T01:29:38.963 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:38 trial040 bash[74349]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3 2026-02-13T01:29:39.218 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:38 trial040 podman[74452]: 2026-02-13 01:29:38.96212117 +0000 UTC m=+0.028349167 container create 42824bbe1bbd47dd4ca1202dd006d3bc581c69a01a2d146b4f8990c70aa1e95a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3-deactivate, version=10, org.opencontainers.image.title=rockylinux, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:29:39.218 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:39 trial040 podman[74452]: 2026-02-13 01:29:39.008872724 +0000 UTC m=+0.075100651 container init 42824bbe1bbd47dd4ca1202dd006d3bc581c69a01a2d146b4f8990c70aa1e95a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3-deactivate, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default) 2026-02-13T01:29:39.218 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:39 trial040 podman[74452]: 2026-02-13 01:29:39.015092218 +0000 UTC m=+0.081320145 container start 42824bbe1bbd47dd4ca1202dd006d3bc581c69a01a2d146b4f8990c70aa1e95a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:29:39.218 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:39 trial040 podman[74452]: 2026-02-13 01:29:39.015817335 +0000 UTC m=+0.082045262 container attach 42824bbe1bbd47dd4ca1202dd006d3bc581c69a01a2d146b4f8990c70aa1e95a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, version=10) 2026-02-13T01:29:39.218 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:39 trial040 podman[74452]: 2026-02-13 01:29:38.951453452 +0000 UTC m=+0.017681379 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:29:39.218 INFO:journalctl@ceph.osd.3.trial040.stdout:Feb 13 01:29:39 trial040 podman[74452]: 2026-02-13 01:29:39.203111415 +0000 UTC m=+0.269339332 container died 42824bbe1bbd47dd4ca1202dd006d3bc581c69a01a2d146b4f8990c70aa1e95a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-3-deactivate, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, license=BSD-3-Clause) 2026-02-13T01:29:39.289 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.3.service' 2026-02-13T01:29:39.360 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:39.360 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-13T01:29:39.360 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-13T01:29:39.361 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.4 2026-02-13T01:29:39.741 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:39 trial055 systemd[1]: Stopping Ceph osd.4 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:39.742 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:39 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4[39626]: 2026-02-13T01:29:39.459+0000 7fc6ce85d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:29:39.742 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:39 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4[39626]: 2026-02-13T01:29:39.459+0000 7fc6ce85d6c0 -1 osd.4 76 *** Got signal Terminated *** 2026-02-13T01:29:39.742 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:39 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4[39626]: 2026-02-13T01:29:39.459+0000 7fc6ce85d6c0 -1 osd.4 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:29:42.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:41 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:41.888+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:42.749 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:42 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:42.304+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:43.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:42 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:42.753+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:43.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:42 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:42.884+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:43.504 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:43 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:43.093+0000 7f752147b6c0 -1 osd.5 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:18.871830+0000 front 2026-02-13T01:29:18.871841+0000 (oldest deadline 2026-02-13T01:29:42.971889+0000) 2026-02-13T01:29:43.748 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:43 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:43.272+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:44.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:43 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:43.680+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:44.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:43 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:43.753+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:44.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:43 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:43.930+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:44.503 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:44 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:44.048+0000 7f752147b6c0 -1 osd.5 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:18.871830+0000 front 2026-02-13T01:29:18.871841+0000 (oldest deadline 2026-02-13T01:29:42.971889+0000) 2026-02-13T01:29:44.748 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:44 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:44.286+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:44.815 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:44 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:44.742+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:44.815 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:44 trial055 podman[59725]: 2026-02-13 01:29:44.528940323 +0000 UTC m=+5.082841591 container died 1cb4e0da63805d7b56ff95a70a433a8d9a310350cf70a0ad837512ef2b64c40b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, io.buildah.version=1.33.7) 2026-02-13T01:29:44.815 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:44 trial055 podman[59725]: 2026-02-13 01:29:44.537959093 +0000 UTC m=+5.091860361 container remove 1cb4e0da63805d7b56ff95a70a433a8d9a310350cf70a0ad837512ef2b64c40b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7) 2026-02-13T01:29:44.815 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:44 trial055 bash[59725]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4 2026-02-13T01:29:44.816 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:44 trial055 podman[59853]: 2026-02-13 01:29:44.66185371 +0000 UTC m=+0.016277207 container create 2b0dc7c76f7a42362644f0005c4b7631fa20dc2c8c8cca799fd7c447f6f6acda (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.version=10, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.title=rockylinux) 2026-02-13T01:29:44.816 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:44 trial055 podman[59853]: 2026-02-13 01:29:44.687954568 +0000 UTC m=+0.042378065 container init 2b0dc7c76f7a42362644f0005c4b7631fa20dc2c8c8cca799fd7c447f6f6acda (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4-deactivate, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10) 2026-02-13T01:29:44.816 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:44 trial055 podman[59853]: 2026-02-13 01:29:44.690634987 +0000 UTC m=+0.045058494 container start 2b0dc7c76f7a42362644f0005c4b7631fa20dc2c8c8cca799fd7c447f6f6acda (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.title=rockylinux) 2026-02-13T01:29:44.816 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:44 trial055 podman[59853]: 2026-02-13 01:29:44.691149762 +0000 UTC m=+0.045573249 container attach 2b0dc7c76f7a42362644f0005c4b7631fa20dc2c8c8cca799fd7c447f6f6acda (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, ceph=True, summary=Rocky Linux Base image, name=rockylinux, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, version=10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:29:44.816 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:44 trial055 podman[59853]: 2026-02-13 01:29:44.655827728 +0000 UTC m=+0.010251235 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:29:44.816 INFO:journalctl@ceph.osd.4.trial055.stdout:Feb 13 01:29:44 trial055 podman[59853]: 2026-02-13 01:29:44.813506107 +0000 UTC m=+0.167929614 container died 2b0dc7c76f7a42362644f0005c4b7631fa20dc2c8c8cca799fd7c447f6f6acda (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-4-deactivate, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10) 2026-02-13T01:29:44.849 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.4.service' 2026-02-13T01:29:44.886 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:44.886 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-13T01:29:44.886 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-13T01:29:44.887 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.5 2026-02-13T01:29:44.910 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:44 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:44.651+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:44.911 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:44 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:44.680+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:45.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:44 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:44.962+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:45.253 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:44 trial118 systemd[1]: Stopping Ceph osd.5 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:45.254 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:44 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:44.983+0000 7f7524db66c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:29:45.254 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:44 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:44.983+0000 7f7524db66c0 -1 osd.5 76 *** Got signal Terminated *** 2026-02-13T01:29:45.254 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:44 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:44.983+0000 7f7524db66c0 -1 osd.5 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:29:45.254 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:45 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:45.012+0000 7f752147b6c0 -1 osd.5 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:18.871830+0000 front 2026-02-13T01:29:18.871841+0000 (oldest deadline 2026-02-13T01:29:42.971889+0000) 2026-02-13T01:29:45.748 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:45 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:45.282+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:45.996 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:45 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:45.691+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:45.996 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:45 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:45.715+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:46.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:45 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:45.763+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:46.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:45 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:45.951+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:46.253 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:45 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:45.995+0000 7f752147b6c0 -1 osd.5 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:18.871830+0000 front 2026-02-13T01:29:18.871841+0000 (oldest deadline 2026-02-13T01:29:42.971889+0000) 2026-02-13T01:29:46.748 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:46 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:46.258+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:46.994 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:46 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:46.682+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:46.995 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:46 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:46.720+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:47.218 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:46 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:46.958+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:47.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:46 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:46.795+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:47.253 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:46 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:46.993+0000 7f752147b6c0 -1 osd.5 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:18.871830+0000 front 2026-02-13T01:29:18.871841+0000 (oldest deadline 2026-02-13T01:29:42.971889+0000) 2026-02-13T01:29:47.499 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:47 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:47.217+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:48.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:47 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:47.635+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:48.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:47 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:47.726+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:48.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:47 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:47.772+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:48.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:47 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:47.823+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:48.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:47 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:47.939+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:48.249 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:48 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:48.184+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:48.249 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:48 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:48.184+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.663363+0000 front 2026-02-13T01:29:26.663447+0000 (oldest deadline 2026-02-13T01:29:47.763410+0000) 2026-02-13T01:29:48.503 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:48 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:48.003+0000 7f752147b6c0 -1 osd.5 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:18.871830+0000 front 2026-02-13T01:29:18.871841+0000 (oldest deadline 2026-02-13T01:29:42.971889+0000) 2026-02-13T01:29:49.003 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:48 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:48.749+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:49.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:48 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:48.623+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:49.209 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:48 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:48.897+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:49.241 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:48 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:48.852+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:49.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:48 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:48.800+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:49.498 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:49 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:49.208+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:49.499 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:49 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:49.208+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.663363+0000 front 2026-02-13T01:29:26.663447+0000 (oldest deadline 2026-02-13T01:29:47.763410+0000) 2026-02-13T01:29:49.503 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:49 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5[40370]: 2026-02-13T01:29:49.015+0000 7f752147b6c0 -1 osd.5 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:18.871830+0000 front 2026-02-13T01:29:18.871841+0000 (oldest deadline 2026-02-13T01:29:42.971889+0000) 2026-02-13T01:29:50.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:49 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:49.666+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:50.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:49 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:49.778+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:50.241 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:49 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:49.900+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:50.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:49 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:49.760+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:50.242 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:49 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:49.930+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:50.349 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:50 trial118 podman[62527]: 2026-02-13 01:29:50.052370818 +0000 UTC m=+5.082024722 container died 746b351392b43ae7bc491f35a30232c3ef7f6326efa8ffcb8a492712390652ec (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.version=10, version=10, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, ceph=True) 2026-02-13T01:29:50.349 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:50 trial118 podman[62527]: 2026-02-13 01:29:50.061135886 +0000 UTC m=+5.090789800 container remove 746b351392b43ae7bc491f35a30232c3ef7f6326efa8ffcb8a492712390652ec (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, license=BSD-3-Clause, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:29:50.349 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:50 trial118 bash[62527]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5 2026-02-13T01:29:50.350 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:50 trial118 podman[62661]: 2026-02-13 01:29:50.18554785 +0000 UTC m=+0.015155161 container create 92f6200573973931711a68104bd904412beb29b42860ea055176cfd914aef2ee (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:29:50.350 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:50 trial118 podman[62661]: 2026-02-13 01:29:50.214831451 +0000 UTC m=+0.044438692 container init 92f6200573973931711a68104bd904412beb29b42860ea055176cfd914aef2ee (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5-deactivate, name=rockylinux, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default) 2026-02-13T01:29:50.350 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:50 trial118 podman[62661]: 2026-02-13 01:29:50.217515151 +0000 UTC m=+0.047122392 container start 92f6200573973931711a68104bd904412beb29b42860ea055176cfd914aef2ee (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5-deactivate, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:29:50.350 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:50 trial118 podman[62661]: 2026-02-13 01:29:50.218066055 +0000 UTC m=+0.047673306 container attach 92f6200573973931711a68104bd904412beb29b42860ea055176cfd914aef2ee (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:29:50.350 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:50 trial118 podman[62661]: 2026-02-13 01:29:50.179364944 +0000 UTC m=+0.008972175 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:29:50.350 INFO:journalctl@ceph.osd.5.trial118.stdout:Feb 13 01:29:50 trial118 podman[62661]: 2026-02-13 01:29:50.348304604 +0000 UTC m=+0.177911845 container died 92f6200573973931711a68104bd904412beb29b42860ea055176cfd914aef2ee (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-5-deactivate, name=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, ceph=True, license=BSD-3-Clause, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:29:50.381 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.5.service' 2026-02-13T01:29:50.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:50.459 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-13T01:29:50.459 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-13T01:29:50.459 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.6 2026-02-13T01:29:50.498 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:50 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:50.241+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:50.499 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:50 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:50.241+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.663363+0000 front 2026-02-13T01:29:26.663447+0000 (oldest deadline 2026-02-13T01:29:47.763410+0000) 2026-02-13T01:29:50.934 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:50 trial040 systemd[1]: Stopping Ceph osd.6 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:50.934 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:50 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:50.642+0000 7f7b886b26c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:29:50.934 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:50 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:50.642+0000 7f7b886b26c0 -1 osd.6 76 *** Got signal Terminated *** 2026-02-13T01:29:50.934 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:50 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:50.642+0000 7f7b886b26c0 -1 osd.6 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:29:51.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:50 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:50.742+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:51.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:50 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:50.742+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:29:51.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:50 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:50.697+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:51.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:50 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:50.697+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:29:51.211 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:50 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:50.933+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:51.212 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:50 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:50.933+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:29:51.241 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:50 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:50.864+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:51.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:50 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:50.797+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:51.498 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:51 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:51.211+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:51.499 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:51 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:51.211+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.663363+0000 front 2026-02-13T01:29:26.663447+0000 (oldest deadline 2026-02-13T01:29:47.763410+0000) 2026-02-13T01:29:52.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:51 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:51.777+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:52.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:51 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:51.777+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:29:52.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:51 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:51.651+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:52.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:51 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:51.651+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:29:52.189 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:51 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:51.927+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:52.189 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:51 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:51.927+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:29:52.241 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:51 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:51.855+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:52.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:51 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:51.753+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:52.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:51 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:51.753+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:29:52.498 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:52 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:52.189+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:52.499 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:52 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:52.189+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.663363+0000 front 2026-02-13T01:29:26.663447+0000 (oldest deadline 2026-02-13T01:29:47.763410+0000) 2026-02-13T01:29:53.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:52 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:52.603+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:53.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:52 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:52.603+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:29:53.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:52 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:52.773+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:53.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:52 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:52.773+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:29:53.157 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:52 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:52.900+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:53.157 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:52 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:52.900+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:29:53.241 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:52 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:52.865+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:53.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:52 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:52.777+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:53.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:52 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:52.777+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:29:53.499 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:53 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:53.157+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:53.499 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:53 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:53.157+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.663363+0000 front 2026-02-13T01:29:26.663447+0000 (oldest deadline 2026-02-13T01:29:47.763410+0000) 2026-02-13T01:29:54.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:53 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:53.610+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:54.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:53 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:53.610+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:29:54.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:53 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:53.728+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:54.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:53 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:53.728+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:29:54.197 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:53 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:53.931+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:54.197 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:53 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:53.931+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:29:54.241 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:53 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:53.856+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:54.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:53 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:53.856+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:31.482821+0000 front 2026-02-13T01:29:31.482931+0000 (oldest deadline 2026-02-13T01:29:53.782770+0000) 2026-02-13T01:29:54.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:53 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:53.823+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:54.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:53 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:53.823+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:29:54.499 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:54 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:54.197+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:54.499 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:54 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:54.197+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.663363+0000 front 2026-02-13T01:29:26.663447+0000 (oldest deadline 2026-02-13T01:29:47.763410+0000) 2026-02-13T01:29:55.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:54 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:54.700+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:55.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:54 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:54.700+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:29:55.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:54 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:54.575+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:55.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:54 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:54.575+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:29:55.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:54 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:54.575+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:29:55.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:54 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:54.797+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:55.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:54 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:54.797+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:29:55.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:54 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:54.843+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:55.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:54 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:54.843+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:31.482821+0000 front 2026-02-13T01:29:31.482931+0000 (oldest deadline 2026-02-13T01:29:53.782770+0000) 2026-02-13T01:29:55.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:54 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:54.928+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:55.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:54 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:54.928+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:29:55.249 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:55.159+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:16.762515+0000 front 2026-02-13T01:29:16.762636+0000 (oldest deadline 2026-02-13T01:29:42.062583+0000) 2026-02-13T01:29:55.249 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6[47409]: 2026-02-13T01:29:55.159+0000 7f7b84d776c0 -1 osd.6 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.663363+0000 front 2026-02-13T01:29:26.663447+0000 (oldest deadline 2026-02-13T01:29:47.763410+0000) 2026-02-13T01:29:55.999 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:55.880+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:55.999 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:55 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:55.880+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:29:55.999 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:55 trial040 podman[74564]: 2026-02-13 01:29:55.738357143 +0000 UTC m=+5.118694935 container died a2cbc234e95b094455f99acd45f88b575c574cf1e79910b766430ec7bd8a756a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, ceph=True, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:29:56.000 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:55 trial040 podman[74564]: 2026-02-13 01:29:55.797125111 +0000 UTC m=+5.177462912 container remove a2cbc234e95b094455f99acd45f88b575c574cf1e79910b766430ec7bd8a756a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, OSD_FLAVOR=default, name=rockylinux, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:29:56.000 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:55 trial040 bash[74564]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6 2026-02-13T01:29:56.003 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:55 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:55.713+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:56.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:55 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:55.713+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:29:56.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:55 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:55.713+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:29:56.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:55 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:55.532+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:56.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:55 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:55.532+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:29:56.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:55 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:55.532+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:29:56.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:55 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:55.762+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:56.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:55 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:55.762+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:29:56.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:55 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:55.845+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:56.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:55 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:55.845+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:31.482821+0000 front 2026-02-13T01:29:31.482931+0000 (oldest deadline 2026-02-13T01:29:53.782770+0000) 2026-02-13T01:29:56.307 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:56 trial040 podman[74663]: 2026-02-13 01:29:56.043451418 +0000 UTC m=+0.027619942 container create 400d032dbe8594da7d3ac5c108562bc5a6646b0e724ba7825825f25955549721 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:29:56.307 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:56 trial040 podman[74663]: 2026-02-13 01:29:56.086421216 +0000 UTC m=+0.070589740 container init 400d032dbe8594da7d3ac5c108562bc5a6646b0e724ba7825825f25955549721 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:29:56.307 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:56 trial040 podman[74663]: 2026-02-13 01:29:56.092351353 +0000 UTC m=+0.076519887 container start 400d032dbe8594da7d3ac5c108562bc5a6646b0e724ba7825825f25955549721 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6-deactivate, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:29:56.308 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:56 trial040 podman[74663]: 2026-02-13 01:29:56.093240906 +0000 UTC m=+0.077409440 container attach 400d032dbe8594da7d3ac5c108562bc5a6646b0e724ba7825825f25955549721 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, summary=Rocky Linux Base image, version=10) 2026-02-13T01:29:56.308 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:56 trial040 podman[74663]: 2026-02-13 01:29:56.034272095 +0000 UTC m=+0.018440629 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:29:56.308 INFO:journalctl@ceph.osd.6.trial040.stdout:Feb 13 01:29:56 trial040 podman[74663]: 2026-02-13 01:29:56.27511171 +0000 UTC m=+0.259280244 container died 400d032dbe8594da7d3ac5c108562bc5a6646b0e724ba7825825f25955549721 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-6-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T01:29:56.360 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.6.service' 2026-02-13T01:29:56.469 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:29:56.470 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-13T01:29:56.470 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-13T01:29:56.470 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.7 2026-02-13T01:29:56.777 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:56 trial055 systemd[1]: Stopping Ceph osd.7 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:29:56.777 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:56 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:56.575+0000 7fc5564316c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:29:56.777 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:56 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:56.575+0000 7fc5564316c0 -1 osd.7 76 *** Got signal Terminated *** 2026-02-13T01:29:56.777 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:56 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:56.575+0000 7fc5564316c0 -1 osd.7 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:29:57.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:56 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:56.714+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:57.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:56 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:56.714+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:29:57.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:56 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:56.714+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:29:57.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:56 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:56.509+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:57.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:56 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:56.509+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:29:57.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:56 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:56.509+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:29:57.241 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:56 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:56.895+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:57.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:56 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:56.895+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:31.482821+0000 front 2026-02-13T01:29:31.482931+0000 (oldest deadline 2026-02-13T01:29:53.782770+0000) 2026-02-13T01:29:57.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:56 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:56.774+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:57.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:56 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:56.774+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:29:57.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:56.906+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:57.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:56.906+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:29:57.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:56 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:56.906+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:29:58.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:57 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:57.757+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:58.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:57 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:57.757+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:29:58.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:57 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:57.757+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:29:58.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:57 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:57.540+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:58.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:57 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:57.540+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:29:58.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:57 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:57.540+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:29:58.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:57 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:57.921+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:58.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:57 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:57.921+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:31.482821+0000 front 2026-02-13T01:29:31.482931+0000 (oldest deadline 2026-02-13T01:29:53.782770+0000) 2026-02-13T01:29:58.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:57 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:57.808+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:58.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:57 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:57.808+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:29:58.243 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:57 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:57.808+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:29:58.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:57 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:57.879+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:58.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:57 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:57.879+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:29:58.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:57 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:57.879+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:29:59.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:58 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:58.741+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:29:59.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:58 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:58.741+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:29:59.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:58 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:58.741+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:29:59.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:58 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:58.581+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:29:59.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:58 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:58.581+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:29:59.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:58 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:58.581+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:29:59.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:58 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:58.895+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:29:59.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:58 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:58.895+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:31.482821+0000 front 2026-02-13T01:29:31.482931+0000 (oldest deadline 2026-02-13T01:29:53.782770+0000) 2026-02-13T01:29:59.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:58 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:58.832+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:29:59.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:58 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:58.832+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:29:59.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:58 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:58.832+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:29:59.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:58 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:58.857+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:29:59.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:58 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:58.857+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:29:59.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:58 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:58.857+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:00.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:59 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:59.737+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:30:00.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:59 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:59.737+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:30:00.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:29:59 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:29:59.737+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:30:00.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:59 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:59.535+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:00.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:59 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:59.535+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:00.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:29:59 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:29:59.535+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:00.241 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:59 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:59.903+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:30:00.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:59 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:59.903+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:31.482821+0000 front 2026-02-13T01:29:31.482931+0000 (oldest deadline 2026-02-13T01:29:53.782770+0000) 2026-02-13T01:30:00.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:29:59 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:29:59.903+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.083338+0000 front 2026-02-13T01:29:36.083248+0000 (oldest deadline 2026-02-13T01:29:58.983226+0000) 2026-02-13T01:30:00.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:59 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:59.797+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:00.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:59 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:59.797+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:00.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:29:59 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:29:59.797+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:00.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:59.879+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:00.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:59.879+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:00.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:59.879+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:00.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:29:59 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:29:59.879+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:01.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:00 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:00.520+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:01.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:00 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:00.520+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:01.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:00 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:00.520+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:01.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:00 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:00.520+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:01.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:00 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:00.735+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:30:01.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:00 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:00.735+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:30:01.005 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:00 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:00.735+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:30:01.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:00 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:30:00.952+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.381880+0000 front 2026-02-13T01:29:26.381893+0000 (oldest deadline 2026-02-13T01:29:47.481987+0000) 2026-02-13T01:30:01.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:00 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:30:00.952+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:31.482821+0000 front 2026-02-13T01:29:31.482931+0000 (oldest deadline 2026-02-13T01:29:53.782770+0000) 2026-02-13T01:30:01.242 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:00 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7[45955]: 2026-02-13T01:30:00.952+0000 7fc552af66c0 -1 osd.7 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.083338+0000 front 2026-02-13T01:29:36.083248+0000 (oldest deadline 2026-02-13T01:29:58.983226+0000) 2026-02-13T01:30:01.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:00 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:00.838+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:01.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:00 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:00.838+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:01.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:00 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:00.838+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:01.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:00.889+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:01.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:00.889+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:01.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:00.889+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:01.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:00 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:00.889+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:01.754 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:01 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:01.725+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:30:01.754 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:01 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:01.725+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:30:01.754 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:01 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:01.725+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:30:01.754 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:01 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:01.725+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:35.213933+0000 front 2026-02-13T01:29:35.213883+0000 (oldest deadline 2026-02-13T01:30:01.113949+0000) 2026-02-13T01:30:01.754 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:01 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:01.498+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:01.754 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:01 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:01.498+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:01.755 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:01 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:01.498+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:01.755 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:01 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:01.498+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:01.937 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:01 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:01.846+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:01.937 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:01 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:01.846+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:01.938 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:01 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:01.846+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:01.938 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:01 trial055 podman[59988]: 2026-02-13 01:30:01.635474583 +0000 UTC m=+5.071365808 container died 3bd5f96c490a3ebaaac28e98f05814c44c3280038a58135a777a04913513a62f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, ceph=True, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:30:01.938 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:01 trial055 podman[59988]: 2026-02-13 01:30:01.64392577 +0000 UTC m=+5.079816995 container remove 3bd5f96c490a3ebaaac28e98f05814c44c3280038a58135a777a04913513a62f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.title=rockylinux) 2026-02-13T01:30:01.938 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:01 trial055 bash[59988]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7 2026-02-13T01:30:01.938 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:01 trial055 podman[60118]: 2026-02-13 01:30:01.771108854 +0000 UTC m=+0.015902002 container create 13e346ac12029f8e2b9c0da8408b091534ee3dd90601a741530ee956021d5e3f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, version=10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True) 2026-02-13T01:30:01.938 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:01 trial055 podman[60118]: 2026-02-13 01:30:01.808510372 +0000 UTC m=+0.053303520 container init 13e346ac12029f8e2b9c0da8408b091534ee3dd90601a741530ee956021d5e3f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7-deactivate, ceph=True, org.opencontainers.image.version=10, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , version=10, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:30:01.938 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:01 trial055 podman[60118]: 2026-02-13 01:30:01.810853446 +0000 UTC m=+0.055646594 container start 13e346ac12029f8e2b9c0da8408b091534ee3dd90601a741530ee956021d5e3f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause) 2026-02-13T01:30:01.939 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:01 trial055 podman[60118]: 2026-02-13 01:30:01.811385132 +0000 UTC m=+0.056178280 container attach 13e346ac12029f8e2b9c0da8408b091534ee3dd90601a741530ee956021d5e3f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, ceph=True, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T01:30:01.939 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:01 trial055 podman[60118]: 2026-02-13 01:30:01.765104542 +0000 UTC m=+0.009897690 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:30:01.939 INFO:journalctl@ceph.osd.7.trial055.stdout:Feb 13 01:30:01 trial055 podman[60118]: 2026-02-13 01:30:01.935602257 +0000 UTC m=+0.180395405 container died 13e346ac12029f8e2b9c0da8408b091534ee3dd90601a741530ee956021d5e3f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, license=BSD-3-Clause, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T01:30:01.968 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.7.service' 2026-02-13T01:30:02.005 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:02.006 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-13T01:30:02.006 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-13T01:30:02.006 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.8 2026-02-13T01:30:02.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:01 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:01.916+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:02.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:01 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:01.916+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:02.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:01 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:01.916+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:02.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:01 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:01.916+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:02.504 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:02 trial118 systemd[1]: Stopping Ceph osd.8 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:02.504 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:02.122+0000 7f51150076c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:30:02.504 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:02.122+0000 7f51150076c0 -1 osd.8 76 *** Got signal Terminated *** 2026-02-13T01:30:02.504 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:02.122+0000 7f51150076c0 -1 osd.8 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:30:03.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:02.711+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:30:03.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:02.711+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:30:03.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:02.711+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:30:03.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:02.711+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:35.213933+0000 front 2026-02-13T01:29:35.213883+0000 (oldest deadline 2026-02-13T01:30:01.113949+0000) 2026-02-13T01:30:03.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:02.532+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:03.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:02.532+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:03.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:02.532+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:03.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:02 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:02.532+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:03.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:02 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:02.894+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:03.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:02 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:02.894+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:03.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:02 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:02.894+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:03.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:02 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:02.916+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:03.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:02 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:02.916+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:03.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:02 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:02.916+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:03.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:02 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:02.916+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:04.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:03 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:03.759+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:30:04.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:03 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:03.759+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:30:04.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:03 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:03.759+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:30:04.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:03 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:03.759+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:35.213933+0000 front 2026-02-13T01:29:35.213883+0000 (oldest deadline 2026-02-13T01:30:01.113949+0000) 2026-02-13T01:30:04.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:03 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:03.518+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:04.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:03 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:03.518+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:04.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:03 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:03.518+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:04.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:03 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:03.518+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:04.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:03 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:03.868+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:04.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:03 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:03.868+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:04.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:03 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:03.868+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:04.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:03 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:03.868+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:04.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:03.914+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:04.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:03.914+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:04.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:03.914+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:04.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:03 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:03.914+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:05.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:04 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:04.742+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:30:05.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:04 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:04.742+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:30:05.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:04 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:04.742+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:30:05.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:04 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:04.742+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:35.213933+0000 front 2026-02-13T01:29:35.213883+0000 (oldest deadline 2026-02-13T01:30:01.113949+0000) 2026-02-13T01:30:05.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:04 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:04.550+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:05.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:04 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:04.550+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:05.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:04 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:04.550+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:05.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:04 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:04.550+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:05.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:04 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:04.891+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:05.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:04 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:04.891+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:05.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:04 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:04.891+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:05.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:04 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:04.891+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:05.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:04 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:04.962+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:05.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:04 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:04.962+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:05.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:04 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:04.962+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:05.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:04 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:04.962+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:05.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:04 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:04.962+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.741554+0000 front 2026-02-13T01:29:43.741541+0000 (oldest deadline 2026-02-13T01:30:04.841507+0000) 2026-02-13T01:30:06.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:05 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:05.701+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:30:06.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:05 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:05.701+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:30:06.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:05 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:05.701+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:30:06.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:05 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:05.701+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:35.213933+0000 front 2026-02-13T01:29:35.213883+0000 (oldest deadline 2026-02-13T01:30:01.113949+0000) 2026-02-13T01:30:06.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:05 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:05.509+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:06.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:05 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:05.509+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:06.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:05 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:05.509+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:06.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:05 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:05.509+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:06.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:05 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:05.919+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:06.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:05 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:05.919+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:06.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:05 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:05.919+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:06.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:05 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:05.919+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:06.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:05 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:05.944+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:06.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:05 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:05.944+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:06.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:05 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:05.944+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:06.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:05 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:05.944+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:06.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:05 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:05.944+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.741554+0000 front 2026-02-13T01:29:43.741541+0000 (oldest deadline 2026-02-13T01:30:04.841507+0000) 2026-02-13T01:30:07.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:06 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:06.690+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.513221+0000 front 2026-02-13T01:29:20.513143+0000 (oldest deadline 2026-02-13T01:29:44.613177+0000) 2026-02-13T01:30:07.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:06 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:06.690+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:24.613450+0000 front 2026-02-13T01:29:24.613345+0000 (oldest deadline 2026-02-13T01:29:50.513394+0000) 2026-02-13T01:30:07.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:06 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:06.690+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.513563+0000 front 2026-02-13T01:29:30.513584+0000 (oldest deadline 2026-02-13T01:29:55.213638+0000) 2026-02-13T01:30:07.004 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:06 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8[46751]: 2026-02-13T01:30:06.690+0000 7f51116cc6c0 -1 osd.8 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:35.213933+0000 front 2026-02-13T01:29:35.213883+0000 (oldest deadline 2026-02-13T01:30:01.113949+0000) 2026-02-13T01:30:07.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:06 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:06.545+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:07.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:06 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:06.545+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:07.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:06 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:06.545+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:07.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:06 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:06.545+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:07.005 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:06 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:06.545+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:07.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:06 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:06.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:07.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:06 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:06.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:07.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:06 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:06.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:07.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:06 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:06.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:07.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:06 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:06.955+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:07.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:06 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:06.955+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:07.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:06 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:06.955+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:07.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:06 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:06.955+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:07.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:06 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:06.955+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.741554+0000 front 2026-02-13T01:29:43.741541+0000 (oldest deadline 2026-02-13T01:30:04.841507+0000) 2026-02-13T01:30:07.489 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:07 trial118 podman[62797]: 2026-02-13 01:30:07.181792504 +0000 UTC m=+5.071304120 container died d15b6a3523723d9e61cae10fadeb7a27a9886e32ad251c418f1fe43b908689bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, ceph=True, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:30:07.489 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:07 trial118 podman[62797]: 2026-02-13 01:30:07.190322809 +0000 UTC m=+5.079834425 container remove d15b6a3523723d9e61cae10fadeb7a27a9886e32ad251c418f1fe43b908689bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, summary=Rocky Linux Base image, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:30:07.489 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:07 trial118 bash[62797]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8 2026-02-13T01:30:07.489 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:07 trial118 podman[62924]: 2026-02-13 01:30:07.334287352 +0000 UTC m=+0.015937505 container create beecb1a371528e8aae8c30f51661623b5f3371e331f6c31ff51522ea0033f56e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, io.buildah.version=1.33.7, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:30:07.490 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:07 trial118 podman[62924]: 2026-02-13 01:30:07.361816511 +0000 UTC m=+0.043466664 container init beecb1a371528e8aae8c30f51661623b5f3371e331f6c31ff51522ea0033f56e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8-deactivate, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, ceph=True) 2026-02-13T01:30:07.490 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:07 trial118 podman[62924]: 2026-02-13 01:30:07.364372983 +0000 UTC m=+0.046023126 container start beecb1a371528e8aae8c30f51661623b5f3371e331f6c31ff51522ea0033f56e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:30:07.490 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:07 trial118 podman[62924]: 2026-02-13 01:30:07.364928195 +0000 UTC m=+0.046578358 container attach beecb1a371528e8aae8c30f51661623b5f3371e331f6c31ff51522ea0033f56e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8-deactivate, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux) 2026-02-13T01:30:07.490 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:07 trial118 podman[62924]: 2026-02-13 01:30:07.327441698 +0000 UTC m=+0.009091851 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:30:07.490 INFO:journalctl@ceph.osd.8.trial118.stdout:Feb 13 01:30:07 trial118 podman[62924]: 2026-02-13 01:30:07.487900419 +0000 UTC m=+0.169550572 container died beecb1a371528e8aae8c30f51661623b5f3371e331f6c31ff51522ea0033f56e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, name=rockylinux, summary=Rocky Linux Base image, OSD_FLAVOR=default, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:30:07.523 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.8.service' 2026-02-13T01:30:07.560 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:07.560 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-13T01:30:07.560 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-13T01:30:07.561 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.9 2026-02-13T01:30:07.753 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:07 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:07.572+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:07.754 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:07 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:07.572+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:07.754 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:07 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:07.572+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:07.754 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:07 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:07.572+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:07.754 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:07 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:07.572+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:07.947 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:07 trial040 systemd[1]: Stopping Ceph osd.9 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:07.948 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:07 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:07.748+0000 7fcedaa136c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:30:07.948 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:07 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:07.748+0000 7fcedaa136c0 -1 osd.9 76 *** Got signal Terminated *** 2026-02-13T01:30:07.948 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:07 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:07.748+0000 7fcedaa136c0 -1 osd.9 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:30:07.948 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:07 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:07.946+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:07.948 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:07 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:07.946+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:07.948 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:07 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:07.946+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:07.948 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:07 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:07.946+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:07.948 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:07 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:07.946+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.741554+0000 front 2026-02-13T01:29:43.741541+0000 (oldest deadline 2026-02-13T01:30:04.841507+0000) 2026-02-13T01:30:08.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:07 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:07.927+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:08.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:07 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:07.927+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:08.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:07 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:07.927+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:08.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:07 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:07.927+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:09.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:08 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:08.585+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:09.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:08 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:08.585+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:09.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:08 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:08.585+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:09.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:08 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:08.585+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:09.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:08 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:08.585+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:09.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:08 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:08.906+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:09.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:08 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:08.906+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:09.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:08 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:08.906+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:09.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:08 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:08.906+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:09.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:08 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:08.901+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:09.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:08 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:08.901+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:09.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:08 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:08.901+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:09.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:08 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:08.901+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:09.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:08 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:08.901+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.741554+0000 front 2026-02-13T01:29:43.741541+0000 (oldest deadline 2026-02-13T01:30:04.841507+0000) 2026-02-13T01:30:10.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:09 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:09.607+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:10.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:09 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:09.607+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:10.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:09 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:09.607+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:10.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:09 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:09.607+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:10.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:09 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:09.607+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:10.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:09 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:09.920+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:10.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:09 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:09.920+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:10.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:09 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:09.920+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:10.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:09 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:09.920+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:10.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:09 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:09.920+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.337374+0000 front 2026-02-13T01:29:43.337385+0000 (oldest deadline 2026-02-13T01:30:09.237456+0000) 2026-02-13T01:30:10.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:09 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:09.898+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:10.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:09 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:09.898+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:10.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:09 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:09.898+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:10.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:09 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:09.898+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:10.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:09 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:09.898+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.741554+0000 front 2026-02-13T01:29:43.741541+0000 (oldest deadline 2026-02-13T01:30:04.841507+0000) 2026-02-13T01:30:11.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:10 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:10.614+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:11.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:10 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:10.614+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:11.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:10 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:10.614+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:11.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:10 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:10.614+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:11.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:10 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:10.614+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:11.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:10 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:10.958+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:11.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:10 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:10.958+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:11.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:10 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:10.958+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:11.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:10 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:10.958+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:11.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:10 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:10.958+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.337374+0000 front 2026-02-13T01:29:43.337385+0000 (oldest deadline 2026-02-13T01:30:09.237456+0000) 2026-02-13T01:30:11.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:10 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:10.958+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:49.237637+0000 front 2026-02-13T01:29:49.237646+0000 (oldest deadline 2026-02-13T01:30:10.937674+0000) 2026-02-13T01:30:11.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:10 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:10.884+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:11.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:10 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:10.884+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:11.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:10 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:10.884+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:11.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:10 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:10.884+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:11.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:10 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:10.884+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.741554+0000 front 2026-02-13T01:29:43.741541+0000 (oldest deadline 2026-02-13T01:30:04.841507+0000) 2026-02-13T01:30:12.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:11 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:11.584+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:12.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:11 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:11.584+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:12.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:11 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:11.584+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:12.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:11 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:11.584+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:12.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:11 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:11.584+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:12.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:11 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:11.933+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:12.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:11 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:11.933+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:12.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:11 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:11.933+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:12.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:11 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:11.933+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:12.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:11 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:11.933+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.337374+0000 front 2026-02-13T01:29:43.337385+0000 (oldest deadline 2026-02-13T01:30:09.237456+0000) 2026-02-13T01:30:12.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:11 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:11.933+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:49.237637+0000 front 2026-02-13T01:29:49.237646+0000 (oldest deadline 2026-02-13T01:30:10.937674+0000) 2026-02-13T01:30:12.248 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:11 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:11.836+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.439202+0000 front 2026-02-13T01:29:19.439380+0000 (oldest deadline 2026-02-13T01:29:41.739289+0000) 2026-02-13T01:30:12.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:11 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:11.836+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.140531+0000 front 2026-02-13T01:29:26.140538+0000 (oldest deadline 2026-02-13T01:29:50.840516+0000) 2026-02-13T01:30:12.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:11 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:11.836+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.840852+0000 front 2026-02-13T01:29:30.840717+0000 (oldest deadline 2026-02-13T01:29:56.740755+0000) 2026-02-13T01:30:12.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:11 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:11.836+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:36.740998+0000 front 2026-02-13T01:29:36.741111+0000 (oldest deadline 2026-02-13T01:29:59.041024+0000) 2026-02-13T01:30:12.249 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:11 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9[53195]: 2026-02-13T01:30:11.836+0000 7fced70d86c0 -1 osd.9 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.741554+0000 front 2026-02-13T01:29:43.741541+0000 (oldest deadline 2026-02-13T01:30:04.841507+0000) 2026-02-13T01:30:13.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:12 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:12.589+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:13.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:12 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:12.589+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:13.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:12 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:12.589+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:13.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:12 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:12.589+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:13.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:12 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:12.589+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:13.134 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:12 trial040 podman[74776]: 2026-02-13 01:30:12.834541401 +0000 UTC m=+5.108933461 container died 7f85b8149ed01c383049373828afd239c1eb467dbc62727ed40982d65217a3e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:30:13.134 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:12 trial040 podman[74776]: 2026-02-13 01:30:12.8924371 +0000 UTC m=+5.166829160 container remove 7f85b8149ed01c383049373828afd239c1eb467dbc62727ed40982d65217a3e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.title=rockylinux, name=rockylinux, OSD_FLAVOR=default) 2026-02-13T01:30:13.134 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:12 trial040 bash[74776]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9 2026-02-13T01:30:13.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:12 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:12.947+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:13.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:12 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:12.947+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:13.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:12 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:12.947+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:13.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:12 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:12.947+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:13.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:12 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:12.947+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.337374+0000 front 2026-02-13T01:29:43.337385+0000 (oldest deadline 2026-02-13T01:30:09.237456+0000) 2026-02-13T01:30:13.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:12 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:12.947+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:49.237637+0000 front 2026-02-13T01:29:49.237646+0000 (oldest deadline 2026-02-13T01:30:10.937674+0000) 2026-02-13T01:30:13.399 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:13 trial040 podman[74875]: 2026-02-13 01:30:13.134062781 +0000 UTC m=+0.026590828 container create ff7f32d63962675299c5ea06e3758b97b7df998538e71da04285a72a26bd8677 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9-deactivate, io.buildah.version=1.33.7, version=10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:30:13.399 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:13 trial040 podman[74875]: 2026-02-13 01:30:13.181875564 +0000 UTC m=+0.074403561 container init ff7f32d63962675299c5ea06e3758b97b7df998538e71da04285a72a26bd8677 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, license=BSD-3-Clause, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, OSD_FLAVOR=default, ceph=True) 2026-02-13T01:30:13.399 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:13 trial040 podman[74875]: 2026-02-13 01:30:13.18790403 +0000 UTC m=+0.080432027 container start ff7f32d63962675299c5ea06e3758b97b7df998538e71da04285a72a26bd8677 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9-deactivate, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:30:13.399 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:13 trial040 podman[74875]: 2026-02-13 01:30:13.188833116 +0000 UTC m=+0.081361113 container attach ff7f32d63962675299c5ea06e3758b97b7df998538e71da04285a72a26bd8677 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7) 2026-02-13T01:30:13.400 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:13 trial040 podman[74875]: 2026-02-13 01:30:13.124872071 +0000 UTC m=+0.017400068 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:30:13.400 INFO:journalctl@ceph.osd.9.trial040.stdout:Feb 13 01:30:13 trial040 podman[74875]: 2026-02-13 01:30:13.368143359 +0000 UTC m=+0.260671366 container died ff7f32d63962675299c5ea06e3758b97b7df998538e71da04285a72a26bd8677 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-9-deactivate, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, summary=Rocky Linux Base image, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:30:13.450 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.9.service' 2026-02-13T01:30:13.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:13.520 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-13T01:30:13.520 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-13T01:30:13.520 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.10 2026-02-13T01:30:13.905 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:13 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:13.627+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:13.905 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:13 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:13.627+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:13.905 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:13 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:13.627+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:13.905 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:13 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:13.627+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:13.905 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:13 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:13.627+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:13.905 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:13 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:13.627+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:13.907 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 systemd[1]: Stopping Ceph osd.10 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:13.907 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:13.628+0000 7f7c83fbb6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:30:13.907 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:13.628+0000 7f7c83fbb6c0 -1 osd.10 76 *** Got signal Terminated *** 2026-02-13T01:30:13.907 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:13.628+0000 7f7c83fbb6c0 -1 osd.10 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:30:13.907 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:13.905+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:13.907 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:13.905+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:13.907 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:13.905+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:13.907 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:13.905+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:13.908 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:13.905+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.337374+0000 front 2026-02-13T01:29:43.337385+0000 (oldest deadline 2026-02-13T01:30:09.237456+0000) 2026-02-13T01:30:13.908 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:13 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:13.905+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:49.237637+0000 front 2026-02-13T01:29:49.237646+0000 (oldest deadline 2026-02-13T01:30:10.937674+0000) 2026-02-13T01:30:15.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:14 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:14.660+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:15.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:14 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:14.660+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:15.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:14 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:14.660+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:15.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:14 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:14.660+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:15.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:14 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:14.660+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:15.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:14 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:14.660+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:15.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:14 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:14.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:15.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:14 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:14.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:15.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:14 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:14.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:15.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:14 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:14.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:15.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:14 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:14.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.337374+0000 front 2026-02-13T01:29:43.337385+0000 (oldest deadline 2026-02-13T01:30:09.237456+0000) 2026-02-13T01:30:15.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:14 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:14.930+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:49.237637+0000 front 2026-02-13T01:29:49.237646+0000 (oldest deadline 2026-02-13T01:30:10.937674+0000) 2026-02-13T01:30:16.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:15 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:15.681+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:16.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:15 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:15.681+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:16.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:15 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:15.681+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:16.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:15 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:15.681+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:16.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:15 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:15.681+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:16.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:15 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:15.681+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:16.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:15 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:15.886+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:16.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:15 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:15.886+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:16.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:15 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:15.886+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:16.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:15 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:15.886+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:16.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:15 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:15.886+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.337374+0000 front 2026-02-13T01:29:43.337385+0000 (oldest deadline 2026-02-13T01:30:09.237456+0000) 2026-02-13T01:30:16.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:15 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:15.886+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:49.237637+0000 front 2026-02-13T01:29:49.237646+0000 (oldest deadline 2026-02-13T01:30:10.937674+0000) 2026-02-13T01:30:17.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:16 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:16.699+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:17.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:16 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:16.699+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:17.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:16 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:16.699+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:17.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:16 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:16.699+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:17.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:16 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:16.699+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:17.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:16 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:16.699+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:17.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:16 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:16.932+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:17.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:16 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:16.932+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:17.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:16 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:16.932+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:17.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:16 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:16.932+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:17.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:16 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:16.932+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.337374+0000 front 2026-02-13T01:29:43.337385+0000 (oldest deadline 2026-02-13T01:30:09.237456+0000) 2026-02-13T01:30:17.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:16 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:16.932+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:49.237637+0000 front 2026-02-13T01:29:49.237646+0000 (oldest deadline 2026-02-13T01:30:10.937674+0000) 2026-02-13T01:30:17.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:16 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:16.932+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6822 osd.6 since back 2026-02-13T01:29:50.937979+0000 front 2026-02-13T01:29:50.937998+0000 (oldest deadline 2026-02-13T01:30:16.237872+0000) 2026-02-13T01:30:18.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:17 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:17.682+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:18.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:17 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:17.682+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:18.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:17 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:17.682+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:18.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:17 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:17.682+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:18.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:17 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:17.682+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:18.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:17 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:17.682+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:18.241 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:17 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:17.884+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:19.936108+0000 front 2026-02-13T01:29:19.936180+0000 (oldest deadline 2026-02-13T01:29:42.236107+0000) 2026-02-13T01:30:18.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:17 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:17.884+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.936546+0000 front 2026-02-13T01:29:26.936555+0000 (oldest deadline 2026-02-13T01:29:51.036653+0000) 2026-02-13T01:30:18.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:17 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:17.884+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:32.737050+0000 front 2026-02-13T01:29:32.737112+0000 (oldest deadline 2026-02-13T01:29:57.437044+0000) 2026-02-13T01:30:18.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:17 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:17.884+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:37.437283+0000 front 2026-02-13T01:29:37.437275+0000 (oldest deadline 2026-02-13T01:30:03.337257+0000) 2026-02-13T01:30:18.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:17 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:17.884+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:43.337374+0000 front 2026-02-13T01:29:43.337385+0000 (oldest deadline 2026-02-13T01:30:09.237456+0000) 2026-02-13T01:30:18.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:17 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:17.884+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:49.237637+0000 front 2026-02-13T01:29:49.237646+0000 (oldest deadline 2026-02-13T01:30:10.937674+0000) 2026-02-13T01:30:18.242 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:17 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10[52189]: 2026-02-13T01:30:17.884+0000 7f7c806806c0 -1 osd.10 76 heartbeat_check: no reply from 10.20.193.40:6822 osd.6 since back 2026-02-13T01:29:50.937979+0000 front 2026-02-13T01:29:50.937998+0000 (oldest deadline 2026-02-13T01:30:16.237872+0000) 2026-02-13T01:30:18.992 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:18 trial055 podman[60252]: 2026-02-13 01:30:18.697929999 +0000 UTC m=+5.082921333 container died 2de67711f33db0396aed567483b2b155f32d53945b4ef7efe09119b503beef3f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:30:18.993 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:18 trial055 podman[60252]: 2026-02-13 01:30:18.706338296 +0000 UTC m=+5.091329640 container remove 2de67711f33db0396aed567483b2b155f32d53945b4ef7efe09119b503beef3f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10, io.buildah.version=1.33.7, license=BSD-3-Clause, summary=Rocky Linux Base image, name=rockylinux, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default) 2026-02-13T01:30:18.993 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:18 trial055 bash[60252]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10 2026-02-13T01:30:18.993 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:18 trial055 podman[60381]: 2026-02-13 01:30:18.833940264 +0000 UTC m=+0.016515066 container create dddffec324122003fbbac3b57d75db8a10ec2223aabcbe84f164b1fe5b94f7c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, io.buildah.version=1.33.7, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:30:18.993 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:18 trial055 podman[60381]: 2026-02-13 01:30:18.867165717 +0000 UTC m=+0.049740509 container init dddffec324122003fbbac3b57d75db8a10ec2223aabcbe84f164b1fe5b94f7c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.version=10, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:30:18.993 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:18 trial055 podman[60381]: 2026-02-13 01:30:18.870013917 +0000 UTC m=+0.052588719 container start dddffec324122003fbbac3b57d75db8a10ec2223aabcbe84f164b1fe5b94f7c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10-deactivate, name=rockylinux, version=10, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:30:18.993 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:18 trial055 podman[60381]: 2026-02-13 01:30:18.870522771 +0000 UTC m=+0.053097583 container attach dddffec324122003fbbac3b57d75db8a10ec2223aabcbe84f164b1fe5b94f7c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-10-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, io.buildah.version=1.33.7, name=rockylinux, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:30:18.993 INFO:journalctl@ceph.osd.10.trial055.stdout:Feb 13 01:30:18 trial055 podman[60381]: 2026-02-13 01:30:18.82752991 +0000 UTC m=+0.010104713 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:30:19.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:18 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:18.677+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:19.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:18 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:18.677+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:19.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:18 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:18.677+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:19.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:18 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:18.677+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:19.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:18 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:18.677+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:19.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:18 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:18.677+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:19.035 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.10.service' 2026-02-13T01:30:19.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:19.072 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-13T01:30:19.072 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-13T01:30:19.072 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.11 2026-02-13T01:30:19.504 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 systemd[1]: Stopping Ceph osd.11 for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:19.504 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:19.168+0000 7fdbe66736c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:30:19.504 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:19.168+0000 7fdbe66736c0 -1 osd.11 76 *** Got signal Terminated *** 2026-02-13T01:30:19.504 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:19.168+0000 7fdbe66736c0 -1 osd.11 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:30:20.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:19.690+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:20.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:19.690+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:20.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:19.690+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:20.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:19.690+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:20.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:19.690+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:20.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:19 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:19.690+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:21.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:20 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:20.674+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:21.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:20 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:20.674+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:21.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:20 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:20.674+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:21.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:20 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:20.674+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:21.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:20 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:20.674+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:21.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:20 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:20.674+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:22.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:21 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:21.714+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:22.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:21 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:21.714+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:22.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:21 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:21.714+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:22.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:21 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:21.714+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:22.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:21 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:21.714+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:22.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:21 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:21.714+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:23.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:22 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:22.701+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:23.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:22 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:22.701+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:23.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:22 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:22.701+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:23.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:22 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:22.701+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:23.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:22 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:22.701+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:23.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:22 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:22.701+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:24.003 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:23 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:23.735+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6806 osd.0 since back 2026-02-13T01:29:20.072388+0000 front 2026-02-13T01:29:20.072480+0000 (oldest deadline 2026-02-13T01:29:42.972483+0000) 2026-02-13T01:30:24.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:23 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:23.735+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6804 osd.1 since back 2026-02-13T01:29:26.472934+0000 front 2026-02-13T01:29:26.472946+0000 (oldest deadline 2026-02-13T01:29:50.573017+0000) 2026-02-13T01:30:24.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:23 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:23.735+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6804 osd.2 since back 2026-02-13T01:29:30.573170+0000 front 2026-02-13T01:29:30.573184+0000 (oldest deadline 2026-02-13T01:29:54.073336+0000) 2026-02-13T01:30:24.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:23 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:23.735+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.40:6814 osd.3 since back 2026-02-13T01:29:34.073697+0000 front 2026-02-13T01:29:34.073655+0000 (oldest deadline 2026-02-13T01:29:59.973555+0000) 2026-02-13T01:30:24.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:23 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:23.735+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.55:6812 osd.4 since back 2026-02-13T01:29:42.873993+0000 front 2026-02-13T01:29:42.873985+0000 (oldest deadline 2026-02-13T01:30:05.774003+0000) 2026-02-13T01:30:24.004 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:23 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11[53408]: 2026-02-13T01:30:23.735+0000 7fdbded306c0 -1 osd.11 76 heartbeat_check: no reply from 10.20.193.118:6812 osd.5 since back 2026-02-13T01:29:47.974444+0000 front 2026-02-13T01:29:47.974472+0000 (oldest deadline 2026-02-13T01:30:13.274523+0000) 2026-02-13T01:30:24.504 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:24 trial118 podman[63059]: 2026-02-13 01:30:24.238504161 +0000 UTC m=+5.082116318 container died 2446cbd38b76208433ea916db015674ca98431b827f80163245ca4ddd643bc7a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, summary=Rocky Linux Base image, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, license=BSD-3-Clause) 2026-02-13T01:30:24.504 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:24 trial118 podman[63059]: 2026-02-13 01:30:24.24776781 +0000 UTC m=+5.091379977 container remove 2446cbd38b76208433ea916db015674ca98431b827f80163245ca4ddd643bc7a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11, summary=Rocky Linux Base image, version=10, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:30:24.505 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:24 trial118 bash[63059]: ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11 2026-02-13T01:30:24.505 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:24 trial118 podman[63189]: 2026-02-13 01:30:24.388792558 +0000 UTC m=+0.016633648 container create 88ec7fdf294281f231699e804724d8f305beab9861128e9c3128964180d8a4ea (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, OSD_FLAVOR=default, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:30:24.505 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:24 trial118 podman[63189]: 2026-02-13 01:30:24.426156228 +0000 UTC m=+0.053997318 container init 88ec7fdf294281f231699e804724d8f305beab9861128e9c3128964180d8a4ea (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux) 2026-02-13T01:30:24.505 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:24 trial118 podman[63189]: 2026-02-13 01:30:24.428781978 +0000 UTC m=+0.056623068 container start 88ec7fdf294281f231699e804724d8f305beab9861128e9c3128964180d8a4ea (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11-deactivate, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, version=10, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:30:24.505 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:24 trial118 podman[63189]: 2026-02-13 01:30:24.429264745 +0000 UTC m=+0.057105845 container attach 88ec7fdf294281f231699e804724d8f305beab9861128e9c3128964180d8a4ea (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-304b456c-087a-11f1-98ea-d404e6e7d460-osd-11-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.version=10, ceph=True, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:30:24.505 INFO:journalctl@ceph.osd.11.trial118.stdout:Feb 13 01:30:24 trial118 podman[63189]: 2026-02-13 01:30:24.382166412 +0000 UTC m=+0.010007502 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:30:24.585 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@osd.11.service' 2026-02-13T01:30:24.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:24.622 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-13T01:30:24.622 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-13T01:30:24.622 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.a 2026-02-13T01:30:24.999 INFO:journalctl@ceph.mds.a.trial040.stdout:Feb 13 01:30:24 trial040 systemd[1]: Stopping Ceph mds.a for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:24.999 INFO:journalctl@ceph.mds.a.trial040.stdout:Feb 13 01:30:24 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-a[58615]: 2026-02-13T01:30:24.800+0000 7f13574576c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:24.999 INFO:journalctl@ceph.mds.a.trial040.stdout:Feb 13 01:30:24 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-a[58615]: 2026-02-13T01:30:24.800+0000 7f13574576c0 -1 mds.a *** got signal Terminated *** 2026-02-13T01:30:25.920 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.a.service' 2026-02-13T01:30:25.988 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:25.988 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-13T01:30:25.988 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-13T01:30:25.988 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.d 2026-02-13T01:30:26.499 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:30:26 trial040 systemd[1]: Stopping Ceph mds.d for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:26.499 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:30:26 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-d[57779]: 2026-02-13T01:30:26.165+0000 7f8ad8c496c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:26.499 INFO:journalctl@ceph.mds.d.trial040.stdout:Feb 13 01:30:26 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-d[57779]: 2026-02-13T01:30:26.165+0000 7f8ad8c496c0 -1 mds.d *** got signal Terminated *** 2026-02-13T01:30:27.290 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.d.service' 2026-02-13T01:30:27.356 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:27.357 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-13T01:30:27.357 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-13T01:30:27.357 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.g 2026-02-13T01:30:27.749 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:30:27 trial040 systemd[1]: Stopping Ceph mds.g for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:27.749 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:30:27 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-g[58241]: 2026-02-13T01:30:27.531+0000 7fe424e1f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:27.749 INFO:journalctl@ceph.mds.g.trial040.stdout:Feb 13 01:30:27 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-g[58241]: 2026-02-13T01:30:27.531+0000 7fe424e1f6c0 -1 mds.g *** got signal Terminated *** 2026-02-13T01:30:28.652 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.g.service' 2026-02-13T01:30:28.717 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:28.717 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-13T01:30:28.718 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-13T01:30:28.718 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.j 2026-02-13T01:30:29.249 INFO:journalctl@ceph.mds.j.trial040.stdout:Feb 13 01:30:28 trial040 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-j[57480]: 2026-02-13T01:30:28.889+0000 7f1004c006c0 -1 mds.j *** got signal Terminated *** 2026-02-13T01:30:30.004 DEBUG:teuthology.orchestra.run.trial040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.j.service' 2026-02-13T01:30:30.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:30.072 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-13T01:30:30.072 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-13T01:30:30.072 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.b 2026-02-13T01:30:30.491 INFO:journalctl@ceph.mds.b.trial055.stdout:Feb 13 01:30:30 trial055 systemd[1]: Stopping Ceph mds.b for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:30.492 INFO:journalctl@ceph.mds.b.trial055.stdout:Feb 13 01:30:30 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-b[56711]: 2026-02-13T01:30:30.169+0000 7fa30dfc96c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:30.492 INFO:journalctl@ceph.mds.b.trial055.stdout:Feb 13 01:30:30 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-b[56711]: 2026-02-13T01:30:30.169+0000 7fa30dfc96c0 -1 mds.b *** got signal Terminated *** 2026-02-13T01:30:37.560 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.b.service' 2026-02-13T01:30:37.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:37.595 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-13T01:30:37.595 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-13T01:30:37.595 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.e 2026-02-13T01:30:37.741 INFO:journalctl@ceph.mds.e.trial055.stdout:Feb 13 01:30:37 trial055 systemd[1]: Stopping Ceph mds.e for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:37.742 INFO:journalctl@ceph.mds.e.trial055.stdout:Feb 13 01:30:37 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-e[56061]: 2026-02-13T01:30:37.723+0000 7f90cf5f86c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:37.742 INFO:journalctl@ceph.mds.e.trial055.stdout:Feb 13 01:30:37 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-e[56061]: 2026-02-13T01:30:37.723+0000 7f90cf5f86c0 -1 mds.e *** got signal Terminated *** 2026-02-13T01:30:39.018 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.e.service' 2026-02-13T01:30:39.052 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:39.052 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-13T01:30:39.052 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-13T01:30:39.052 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.h 2026-02-13T01:30:39.186 INFO:journalctl@ceph.mds.h.trial055.stdout:Feb 13 01:30:39 trial055 systemd[1]: Stopping Ceph mds.h for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:39.491 INFO:journalctl@ceph.mds.h.trial055.stdout:Feb 13 01:30:39 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-h[56386]: 2026-02-13T01:30:39.183+0000 7f9f28e576c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:39.492 INFO:journalctl@ceph.mds.h.trial055.stdout:Feb 13 01:30:39 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-h[56386]: 2026-02-13T01:30:39.183+0000 7f9f28e576c0 -1 mds.h *** got signal Terminated *** 2026-02-13T01:30:42.190 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.h.service' 2026-02-13T01:30:42.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:42.224 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-13T01:30:42.224 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-13T01:30:42.224 DEBUG:teuthology.orchestra.run.trial055:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.k 2026-02-13T01:30:42.491 INFO:journalctl@ceph.mds.k.trial055.stdout:Feb 13 01:30:42 trial055 systemd[1]: Stopping Ceph mds.k for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:42.492 INFO:journalctl@ceph.mds.k.trial055.stdout:Feb 13 01:30:42 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-k[55736]: 2026-02-13T01:30:42.353+0000 7ff1e1b566c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:42.492 INFO:journalctl@ceph.mds.k.trial055.stdout:Feb 13 01:30:42 trial055 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-k[55736]: 2026-02-13T01:30:42.353+0000 7ff1e1b566c0 -1 mds.k *** got signal Terminated *** 2026-02-13T01:30:43.389 DEBUG:teuthology.orchestra.run.trial055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.k.service' 2026-02-13T01:30:43.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:43.423 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-13T01:30:43.423 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-13T01:30:43.423 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.c 2026-02-13T01:30:43.753 INFO:journalctl@ceph.mds.c.trial118.stdout:Feb 13 01:30:43 trial118 systemd[1]: Stopping Ceph mds.c for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:43.754 INFO:journalctl@ceph.mds.c.trial118.stdout:Feb 13 01:30:43 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-c[58007]: 2026-02-13T01:30:43.523+0000 7fbbe37ff6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:43.754 INFO:journalctl@ceph.mds.c.trial118.stdout:Feb 13 01:30:43 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-c[58007]: 2026-02-13T01:30:43.523+0000 7fbbe37ff6c0 -1 mds.c *** got signal Terminated *** 2026-02-13T01:30:44.646 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.c.service' 2026-02-13T01:30:44.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:44.681 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-13T01:30:44.681 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-13T01:30:44.681 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.f 2026-02-13T01:30:45.003 INFO:journalctl@ceph.mds.f.trial118.stdout:Feb 13 01:30:44 trial118 systemd[1]: Stopping Ceph mds.f for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:45.004 INFO:journalctl@ceph.mds.f.trial118.stdout:Feb 13 01:30:44 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-f[57687]: 2026-02-13T01:30:44.810+0000 7f9360a5d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:45.004 INFO:journalctl@ceph.mds.f.trial118.stdout:Feb 13 01:30:44 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-f[57687]: 2026-02-13T01:30:44.810+0000 7f9360a5d6c0 -1 mds.f *** got signal Terminated *** 2026-02-13T01:30:45.927 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.f.service' 2026-02-13T01:30:45.962 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:45.962 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-13T01:30:45.963 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-13T01:30:45.963 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.i 2026-02-13T01:30:46.254 INFO:journalctl@ceph.mds.i.trial118.stdout:Feb 13 01:30:46 trial118 systemd[1]: Stopping Ceph mds.i for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:46.254 INFO:journalctl@ceph.mds.i.trial118.stdout:Feb 13 01:30:46 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-i[58330]: 2026-02-13T01:30:46.089+0000 7f53ea35b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:46.254 INFO:journalctl@ceph.mds.i.trial118.stdout:Feb 13 01:30:46 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-i[58330]: 2026-02-13T01:30:46.089+0000 7f53ea35b6c0 -1 mds.i *** got signal Terminated *** 2026-02-13T01:30:47.221 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.i.service' 2026-02-13T01:30:47.254 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:47.254 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-13T01:30:47.254 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-13T01:30:47.255 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.l 2026-02-13T01:30:47.503 INFO:journalctl@ceph.mds.l.trial118.stdout:Feb 13 01:30:47 trial118 systemd[1]: Stopping Ceph mds.l for 304b456c-087a-11f1-98ea-d404e6e7d460... 2026-02-13T01:30:47.504 INFO:journalctl@ceph.mds.l.trial118.stdout:Feb 13 01:30:47 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-l[57359]: 2026-02-13T01:30:47.381+0000 7f4de19476c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:47.504 INFO:journalctl@ceph.mds.l.trial118.stdout:Feb 13 01:30:47 trial118 ceph-304b456c-087a-11f1-98ea-d404e6e7d460-mds-l[57359]: 2026-02-13T01:30:47.381+0000 7f4de19476c0 -1 mds.l *** got signal Terminated *** 2026-02-13T01:30:48.422 DEBUG:teuthology.orchestra.run.trial118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-304b456c-087a-11f1-98ea-d404e6e7d460@mds.l.service' 2026-02-13T01:30:48.456 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:48.457 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-13T01:30:48.457 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 --force --keep-logs 2026-02-13T01:30:48.642 INFO:teuthology.orchestra.run.trial040.stdout:Deleting cluster with fsid: 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:30:51.818 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 --force --keep-logs 2026-02-13T01:30:51.938 INFO:teuthology.orchestra.run.trial055.stdout:Deleting cluster with fsid: 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:30:53.743 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 --force --keep-logs 2026-02-13T01:30:53.862 INFO:teuthology.orchestra.run.trial118.stdout:Deleting cluster with fsid: 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:30:55.702 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:30:55.763 DEBUG:teuthology.orchestra.run.trial055:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:30:55.792 DEBUG:teuthology.orchestra.run.trial118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:30:55.819 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-13T01:30:55.821 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421/remote/trial040/crash 2026-02-13T01:30:55.822 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/crash -- . 2026-02-13T01:30:55.878 INFO:teuthology.orchestra.run.trial040.stderr:tar: /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T01:30:55.879 INFO:teuthology.orchestra.run.trial040.stderr:tar: Error is not recoverable: exiting now 2026-02-13T01:30:55.882 DEBUG:teuthology.misc:Transferring archived files from trial055:/var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421/remote/trial055/crash 2026-02-13T01:30:55.883 DEBUG:teuthology.orchestra.run.trial055:> sudo tar c -f - -C /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/crash -- . 2026-02-13T01:30:55.910 INFO:teuthology.orchestra.run.trial055.stderr:tar: /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T01:30:55.910 INFO:teuthology.orchestra.run.trial055.stderr:tar: Error is not recoverable: exiting now 2026-02-13T01:30:55.912 DEBUG:teuthology.misc:Transferring archived files from trial118:/var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421/remote/trial118/crash 2026-02-13T01:30:55.914 DEBUG:teuthology.orchestra.run.trial118:> sudo tar c -f - -C /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/crash -- . 2026-02-13T01:30:55.940 INFO:teuthology.orchestra.run.trial118.stderr:tar: /var/lib/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T01:30:55.940 INFO:teuthology.orchestra.run.trial118.stderr:tar: Error is not recoverable: exiting now 2026-02-13T01:30:55.941 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-13T01:30:55.942 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T01:30:56.006 INFO:teuthology.orchestra.run.trial040.stdout:2026-02-13T01:21:59.653863+0000 mon.a (mon.0) 407 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:30:56.008 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-13T01:30:56.008 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -E '\[SEC\]' /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T01:30:56.073 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -E '\[ERR\]' /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T01:30:56.137 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -E '\[WRN\]' /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T01:30:56.199 INFO:teuthology.orchestra.run.trial040.stdout:2026-02-13T01:21:59.653863+0000 mon.a (mon.0) 407 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:30:56.200 INFO:tasks.cephadm:Compressing logs... 2026-02-13T01:30:56.200 DEBUG:teuthology.orchestra.run.trial040:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:30:56.204 DEBUG:teuthology.orchestra.run.trial055:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:30:56.207 DEBUG:teuthology.orchestra.run.trial118:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:30:56.229 INFO:teuthology.orchestra.run.trial055.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T01:30:56.230 INFO:teuthology.orchestra.run.trial055.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T01:30:56.233 INFO:teuthology.orchestra.run.trial055.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mgr.y.log 2026-02-13T01:30:56.233 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.b.log 2026-02-13T01:30:56.233 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.h.log 2026-02-13T01:30:56.233 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.7.log 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr: 92.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.cephadm.log 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.10.log 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.4.log 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr: 35.2% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.audit.log 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mon.b.log 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-volume.log 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr: 92.2% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.1.log 2026-02-13T01:30:56.234 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log 2026-02-13T01:30:56.237 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.k.log 2026-02-13T01:30:56.237 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.e.log 2026-02-13T01:30:56.237 INFO:teuthology.orchestra.run.trial055.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.k.log: /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.e.log: 87.4% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log.gz 2026-02-13T01:30:56.237 INFO:teuthology.orchestra.run.trial055.stderr: 94.9% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.k.log.gz 2026-02-13T01:30:56.237 INFO:teuthology.orchestra.run.trial055.stderr: 91.0% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.audit.log.gz 2026-02-13T01:30:56.240 INFO:teuthology.orchestra.run.trial055.stderr: 93.3% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-volume.log.gz 2026-02-13T01:30:56.241 INFO:teuthology.orchestra.run.trial118.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T01:30:56.241 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T01:30:56.241 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.2.log 2026-02-13T01:30:56.241 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.i.log 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mon.c.log 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.f.log 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.i.log: /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.5.log 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.cephadm.log 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.11.log 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.5.log: /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.audit.log 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr: 35.2% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-volume.log 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mgr.z.log 2026-02-13T01:30:56.242 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.l.log 2026-02-13T01:30:56.243 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-volume.log: /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.c.log 2026-02-13T01:30:56.243 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log 2026-02-13T01:30:56.243 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.8.log 2026-02-13T01:30:56.243 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log: 91.0% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.audit.log.gz 2026-02-13T01:30:56.243 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.8.log: 87.4% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log.gz 2026-02-13T01:30:56.243 INFO:teuthology.orchestra.run.trial118.stderr: 92.4% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-13T01:30:56.243 INFO:teuthology.orchestra.run.trial118.stderr: 94.9% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.l.log.gz 2026-02-13T01:30:56.243 INFO:teuthology.orchestra.run.trial118.stderr: 94.0% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-volume.log.gz 2026-02-13T01:30:56.244 INFO:teuthology.orchestra.run.trial055.stderr: 94.1% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.h.log.gz 2026-02-13T01:30:56.244 INFO:teuthology.orchestra.run.trial118.stderr: 94.4% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.i.log.gz 2026-02-13T01:30:56.244 INFO:teuthology.orchestra.run.trial118.stderr: 95.1% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.f.log.gz 2026-02-13T01:30:56.248 INFO:teuthology.orchestra.run.trial118.stderr: 94.9% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.c.log.gz 2026-02-13T01:30:56.248 INFO:teuthology.orchestra.run.trial055.stderr: 94.5% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.e.log.gz 2026-02-13T01:30:56.256 INFO:teuthology.orchestra.run.trial040.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T01:30:56.256 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T01:30:56.257 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mon.a.log 2026-02-13T01:30:56.257 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.d.log 2026-02-13T01:30:56.258 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.j.log 2026-02-13T01:30:56.259 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.0.log 2026-02-13T01:30:56.259 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.3.log 2026-02-13T01:30:56.260 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.0.log: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T01:30:56.260 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.cephadm.log 2026-02-13T01:30:56.261 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.3.log: 94.9% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.d.log.gz 2026-02-13T01:30:56.262 INFO:teuthology.orchestra.run.trial055.stderr: 93.4% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.b.log.gz 2026-02-13T01:30:56.262 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.cephadm.log: 60.7% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T01:30:56.262 INFO:teuthology.orchestra.run.trial040.stderr: 94.9%gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.a.log 2026-02-13T01:30:56.262 INFO:teuthology.orchestra.run.trial040.stderr: -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.j.log.gz 2026-02-13T01:30:56.262 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.g.log 2026-02-13T01:30:56.263 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.audit.log 2026-02-13T01:30:56.263 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-volume.log 2026-02-13T01:30:56.264 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.6.log 2026-02-13T01:30:56.265 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-volume.log: 94.9% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.a.log.gz 2026-02-13T01:30:56.266 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mgr.x.log 2026-02-13T01:30:56.266 INFO:teuthology.orchestra.run.trial040.stderr: 94.9% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mds.g.log.gz 2026-02-13T01:30:56.267 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log 2026-02-13T01:30:56.267 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.6.log: 90.9% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.audit.log.gz 2026-02-13T01:30:56.267 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.9.log 2026-02-13T01:30:56.267 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log: /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.9.log: 87.4% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph.log.gz 2026-02-13T01:30:56.270 INFO:teuthology.orchestra.run.trial040.stderr: 93.0% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-volume.log.gz 2026-02-13T01:30:56.334 INFO:teuthology.orchestra.run.trial118.stderr: 91.8% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mon.c.log.gz 2026-02-13T01:30:56.335 INFO:teuthology.orchestra.run.trial055.stderr: 91.7% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mon.b.log.gz 2026-02-13T01:30:56.363 INFO:teuthology.orchestra.run.trial118.stderr: 92.9% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.11.log.gz 2026-02-13T01:30:56.374 INFO:teuthology.orchestra.run.trial040.stderr: 89.9% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-13T01:30:56.393 INFO:teuthology.orchestra.run.trial055.stderr: 92.3% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.4.log.gz 2026-02-13T01:30:56.397 INFO:teuthology.orchestra.run.trial055.stderr: 92.6% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.7.log.gz 2026-02-13T01:30:56.397 INFO:teuthology.orchestra.run.trial118.stderr: 92.5% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.8.log.gz 2026-02-13T01:30:56.418 INFO:teuthology.orchestra.run.trial040.stderr: 92.4% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.9.log.gz 2026-02-13T01:30:56.421 INFO:teuthology.orchestra.run.trial118.stderr: 92.3% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.2.log.gz 2026-02-13T01:30:56.437 INFO:teuthology.orchestra.run.trial040.stderr: 92.3% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.3.log.gz 2026-02-13T01:30:56.442 INFO:teuthology.orchestra.run.trial055.stderr: 92.3% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.1.log.gz 2026-02-13T01:30:56.445 INFO:teuthology.orchestra.run.trial040.stderr: 92.5% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.0.log.gz 2026-02-13T01:30:56.446 INFO:teuthology.orchestra.run.trial040.stderr: 92.3% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.6.log.gz 2026-02-13T01:30:56.449 INFO:teuthology.orchestra.run.trial118.stderr: 92.2% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.5.log.gz 2026-02-13T01:30:56.450 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-13T01:30:56.450 INFO:teuthology.orchestra.run.trial118.stderr:real 0m0.227s 2026-02-13T01:30:56.450 INFO:teuthology.orchestra.run.trial118.stderr:user 0m0.804s 2026-02-13T01:30:56.450 INFO:teuthology.orchestra.run.trial118.stderr:sys 0m0.059s 2026-02-13T01:30:56.453 INFO:teuthology.orchestra.run.trial055.stderr: 92.3% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-osd.10.log.gz 2026-02-13T01:30:56.454 INFO:teuthology.orchestra.run.trial055.stderr: 2026-02-13T01:30:56.454 INFO:teuthology.orchestra.run.trial055.stderr:real 0m0.233s 2026-02-13T01:30:56.454 INFO:teuthology.orchestra.run.trial055.stderr:user 0m0.883s 2026-02-13T01:30:56.454 INFO:teuthology.orchestra.run.trial055.stderr:sys 0m0.067s 2026-02-13T01:30:56.584 INFO:teuthology.orchestra.run.trial040.stderr: 90.2% -- replaced with /var/log/ceph/304b456c-087a-11f1-98ea-d404e6e7d460/ceph-mon.a.log.gz 2026-02-13T01:30:56.587 INFO:teuthology.orchestra.run.trial040.stderr: 2026-02-13T01:30:56.587 INFO:teuthology.orchestra.run.trial040.stderr:real 0m0.349s 2026-02-13T01:30:56.587 INFO:teuthology.orchestra.run.trial040.stderr:user 0m1.010s 2026-02-13T01:30:56.587 INFO:teuthology.orchestra.run.trial040.stderr:sys 0m0.200s 2026-02-13T01:30:56.589 INFO:tasks.cephadm:Archiving logs... 2026-02-13T01:30:56.589 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421/remote/trial040/log 2026-02-13T01:30:56.590 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T01:30:56.788 DEBUG:teuthology.misc:Transferring archived files from trial055:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421/remote/trial055/log 2026-02-13T01:30:56.789 DEBUG:teuthology.orchestra.run.trial055:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T01:30:56.905 DEBUG:teuthology.misc:Transferring archived files from trial118:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421/remote/trial118/log 2026-02-13T01:30:56.905 DEBUG:teuthology.orchestra.run.trial118:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T01:30:57.013 INFO:tasks.cephadm:Removing cluster... 2026-02-13T01:30:57.013 DEBUG:teuthology.orchestra.run.trial040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 --force 2026-02-13T01:30:57.200 INFO:teuthology.orchestra.run.trial040.stdout:Deleting cluster with fsid: 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:30:57.469 DEBUG:teuthology.orchestra.run.trial055:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 --force 2026-02-13T01:30:57.588 INFO:teuthology.orchestra.run.trial055.stdout:Deleting cluster with fsid: 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:30:57.748 DEBUG:teuthology.orchestra.run.trial118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 304b456c-087a-11f1-98ea-d404e6e7d460 --force 2026-02-13T01:30:57.868 INFO:teuthology.orchestra.run.trial118.stdout:Deleting cluster with fsid: 304b456c-087a-11f1-98ea-d404e6e7d460 2026-02-13T01:30:58.035 INFO:tasks.cephadm:Removing cephadm ... 2026-02-13T01:30:58.035 DEBUG:teuthology.orchestra.run.trial040:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T01:30:58.076 DEBUG:teuthology.orchestra.run.trial055:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T01:30:58.093 DEBUG:teuthology.orchestra.run.trial118:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T01:30:58.112 INFO:tasks.cephadm:Teardown complete 2026-02-13T01:30:58.112 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T01:30:58.114 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-13T01:30:58.129 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T01:30:58.144 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T01:30:58.144 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T01:30:58.148 DEBUG:teuthology.orchestra.run.trial055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T01:30:58.151 DEBUG:teuthology.orchestra.run.trial118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T01:30:58.410 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T01:30:58.421 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T01:30:58.421 DEBUG:teuthology.orchestra.run.trial040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:30:58.424 DEBUG:teuthology.orchestra.run.trial055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:30:58.426 DEBUG:teuthology.orchestra.run.trial118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:30:58.440 INFO:teuthology.orchestra.run.trial055.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:30:58.442 INFO:teuthology.orchestra.run.trial118.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:30:58.457 INFO:teuthology.orchestra.run.trial040.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial055.stdout:=============================================================================== 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial055.stdout:^* jane.qotw.net 2 6 377 52 +371us[ +302us] +/- 25ms 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial055.stdout:^- 50.218.103.254 3 6 175 55 +1019us[ +949us] +/- 59ms 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial055.stdout:^+ kjsl-fmt2-net.fmt2.kjsl.> 2 6 377 116 +531us[ +452us] +/- 33ms 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial055.stdout:^+ ntp.sfo.icanbwell.com 2 6 377 53 -914us[ -984us] +/- 38ms 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial118.stdout:=============================================================================== 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial118.stdout:^- dns-e.ns4v.icu 2 6 377 53 +2672us[+2672us] +/- 57ms 2026-02-13T01:30:58.478 INFO:teuthology.orchestra.run.trial118.stdout:^- 163-123-152-14.ip4.evals> 4 6 377 51 -67us[ -67us] +/- 24ms 2026-02-13T01:30:58.479 INFO:teuthology.orchestra.run.trial118.stdout:^- ntp.maxhost.io 2 6 377 113 -8229us[-8205us] +/- 67ms 2026-02-13T01:30:58.479 INFO:teuthology.orchestra.run.trial118.stdout:^* ntp0.alb1.inoc.net 2 6 377 53 +38us[ +64us] +/- 3856us 2026-02-13T01:30:58.485 INFO:teuthology.orchestra.run.trial040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:30:58.485 INFO:teuthology.orchestra.run.trial040.stdout:=============================================================================== 2026-02-13T01:30:58.485 INFO:teuthology.orchestra.run.trial040.stdout:^- ntp1.lax.us.hojmark.net 2 6 377 53 -1209us[-1109us] +/- 67ms 2026-02-13T01:30:58.485 INFO:teuthology.orchestra.run.trial040.stdout:^* 192-210-133-204-host.col> 3 6 377 52 +423us[ +523us] +/- 8256us 2026-02-13T01:30:58.485 INFO:teuthology.orchestra.run.trial040.stdout:^- 172-234-44-141.ip.linode> 2 6 377 50 +24ms[ +24ms] +/- 86ms 2026-02-13T01:30:58.485 INFO:teuthology.orchestra.run.trial040.stdout:^+ ntp2.wiktel.com 1 6 377 54 -959us[ -859us] +/- 20ms 2026-02-13T01:30:58.486 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T01:30:58.497 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T01:30:58.497 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T01:30:58.511 DEBUG:teuthology.orchestra.run.trial040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T01:30:58.630 DEBUG:teuthology.orchestra.run.trial055:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T01:30:58.676 DEBUG:teuthology.orchestra.run.trial118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T01:30:58.722 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:30:58.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:30:58.784 DEBUG:teuthology.orchestra.run.trial055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:30:58.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:30:58.811 DEBUG:teuthology.orchestra.run.trial118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:30:58.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:30:58.839 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T01:30:58.854 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T01:30:58.868 INFO:teuthology.task.internal:Duration was 823.763943 seconds 2026-02-13T01:30:58.869 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T01:30:58.883 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T01:30:58.883 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T01:30:58.888 DEBUG:teuthology.orchestra.run.trial055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T01:30:58.891 DEBUG:teuthology.orchestra.run.trial118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T01:30:58.927 INFO:teuthology.orchestra.run.trial055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:30:58.927 INFO:teuthology.orchestra.run.trial118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:30:58.967 INFO:teuthology.orchestra.run.trial040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:30:59.294 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T01:30:59.294 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial040.front.sepia.ceph.com 2026-02-13T01:30:59.295 DEBUG:teuthology.orchestra.run.trial040:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T01:30:59.340 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial055.front.sepia.ceph.com 2026-02-13T01:30:59.341 DEBUG:teuthology.orchestra.run.trial055:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T01:30:59.361 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial118.front.sepia.ceph.com 2026-02-13T01:30:59.361 DEBUG:teuthology.orchestra.run.trial118:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T01:30:59.382 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T01:30:59.382 DEBUG:teuthology.orchestra.run.trial040:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:30:59.386 DEBUG:teuthology.orchestra.run.trial055:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:30:59.403 DEBUG:teuthology.orchestra.run.trial118:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:30:59.681 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T01:30:59.682 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:30:59.686 DEBUG:teuthology.orchestra.run.trial055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:30:59.689 DEBUG:teuthology.orchestra.run.trial118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:30:59.711 INFO:teuthology.orchestra.run.trial055.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:30:59.711 INFO:teuthology.orchestra.run.trial055.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:30:59.712 INFO:teuthology.orchestra.run.trial055.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:30:59.713 INFO:teuthology.orchestra.run.trial055.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T01:30:59.713 INFO:teuthology.orchestra.run.trial055.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T01:30:59.714 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:30:59.714 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:30:59.716 INFO:teuthology.orchestra.run.trial118.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T01:30:59.716 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:30:59.716 INFO:teuthology.orchestra.run.trial118.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T01:30:59.725 INFO:teuthology.orchestra.run.trial055.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T01:30:59.729 INFO:teuthology.orchestra.run.trial118.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T01:30:59.737 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:30:59.737 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:30:59.738 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:30:59.738 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T01:30:59.739 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T01:30:59.791 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 92.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T01:30:59.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T01:30:59.811 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T01:30:59.811 DEBUG:teuthology.orchestra.run.trial040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T01:30:59.868 DEBUG:teuthology.orchestra.run.trial055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T01:30:59.893 DEBUG:teuthology.orchestra.run.trial118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T01:30:59.919 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T01:30:59.937 DEBUG:teuthology.orchestra.run.trial040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:30:59.941 DEBUG:teuthology.orchestra.run.trial055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:30:59.944 DEBUG:teuthology.orchestra.run.trial118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:30:59.964 INFO:teuthology.orchestra.run.trial055.stdout:kernel.core_pattern = core 2026-02-13T01:30:59.983 INFO:teuthology.orchestra.run.trial118.stdout:kernel.core_pattern = core 2026-02-13T01:31:00.009 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern = core 2026-02-13T01:31:00.038 DEBUG:teuthology.orchestra.run.trial040:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:31:00.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:31:00.075 DEBUG:teuthology.orchestra.run.trial055:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:31:00.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:31:00.093 DEBUG:teuthology.orchestra.run.trial118:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:31:00.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:31:00.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T01:31:00.126 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T01:31:00.127 DEBUG:teuthology.misc:Transferring archived files from trial040:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421/remote/trial040 2026-02-13T01:31:00.127 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T01:31:00.204 DEBUG:teuthology.misc:Transferring archived files from trial055:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421/remote/trial055 2026-02-13T01:31:00.204 DEBUG:teuthology.orchestra.run.trial055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T01:31:00.239 DEBUG:teuthology.misc:Transferring archived files from trial118:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47421/remote/trial118 2026-02-13T01:31:00.239 DEBUG:teuthology.orchestra.run.trial118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T01:31:00.275 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T01:31:00.275 DEBUG:teuthology.orchestra.run.trial040:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T01:31:00.279 DEBUG:teuthology.orchestra.run.trial055:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T01:31:00.282 DEBUG:teuthology.orchestra.run.trial118:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T01:31:00.324 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T01:31:00.343 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T01:31:00.344 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T01:31:00.359 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T01:31:00.359 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T01:31:00.363 DEBUG:teuthology.orchestra.run.trial055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T01:31:00.365 DEBUG:teuthology.orchestra.run.trial118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T01:31:00.380 INFO:teuthology.orchestra.run.trial055.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 01:31 /home/ubuntu/cephtest 2026-02-13T01:31:00.382 INFO:teuthology.orchestra.run.trial118.stdout: 786461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 01:31 /home/ubuntu/cephtest 2026-02-13T01:31:00.397 INFO:teuthology.orchestra.run.trial040.stdout: 1179677 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 01:31 /home/ubuntu/cephtest 2026-02-13T01:31:00.399 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T01:31:00.415 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T01:31:00.454 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} duration: 823.7639427185059 failure_reason: '"2026-02-13T01:21:59.653863+0000 mon.a (mon.0) 407 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL)" in cluster log' flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T01:31:00.454 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:31:00.574 INFO:teuthology.run:FAIL